You work for a multinational bank. There has been a significant increase in the number of customers experiencing credit card fraud over the last few months. A major news outlet even recently published a story about the credit card fraud you and other banks are experiencing.
As a response to this situation, you have been tasked to solve part of this problem by leveraging machine learning to identify fraudulent credit card transactions before they have a larger impact on your company. You have been given access to a dataset of past credit card transactions, which you can use to train a machine learning model to predict if transactions are fraudulent or not.
The dataset contains transactions made by credit cards in September 2013 by European cardholders. This dataset presents transactions that occurred over the course of two days and includes examples of both fraudulent and legitimate transactions.
The dataset contains over 30 numerical features, most of which have undergone principal component analysis (PCA) transformations because of personal privacy issues with the data. The only features that have not been transformed with PCA are 'Time' and 'Amount'. The feature 'Time' contains the seconds elapsed between each transaction and the first transaction in the dataset. The feature 'Amount' is the transaction amount. 'Class' is the response or target variable, and it takes a value of '1' in cases of fraud and '0' otherwise.
Features:
V1, V2, ... V28: Principal components obtained with PCA
Non-PCA features:
Time: Seconds elapsed between each transaction and the first transaction in the dataset, $T_x - t_0$Amount: Transaction amount; this feature can be used for example-dependent cost-sensitive learning Class: Target variable where Fraud = 1 and Not Fraud = 0Website: https://www.openml.org/d/1597
Twitter: https://twitter.com/dalpozz/status/645542397569593344
Authors: Andrea Dal Pozzolo, Olivier Caelen, and Gianluca Bontempi Source: Credit card fraud detection - June 25, 2015 Official citation: Andrea Dal Pozzolo, Olivier Caelen, Reid A. Johnson, and Gianluca Bontempi. Calibrating Probability with Undersampling for Unbalanced Classification. In Symposium on Computational Intelligence and Data Mining (CIDM), IEEE, 2015.
The dataset has been collected and analyzed during a research collaboration of Worldline and the Machine Learning Group (mlg.ulb.ac.be) of ULB (Université Libre de Bruxelles) on big data mining and fraud detection. More details on current and past projects on related topics are available on http://mlg.ulb.ac.be/BruFence and http://mlg.ulb.ac.be/ARTML.
Start this project off by writing a few sentences below that summarize the business problem and the business goal you're trying to achieve in this scenario. Include a business metric you would like your team to aspire toward. With that information defined, clearly write out the machine learning problem statement. Finally, add a comment or two about the type of machine learning this represents.
As we have a label historical dataset, and it is difficult to human to indicate wether it is a Fraud or not as the number of features and transaction is so large.
Identify fraudulent credit card transactions before they have a larger impact on a company.
Decrease in the number of customers experiencing credit card fraud.
Predict if there is a fraud or not.
Binary classification
Good data for ML to work on.
Now that we have decided where to focus our energy, let's set things up so you can start working on solving the problem.
Note: This notebook was created and tested on an ml.m4.xlarge notebook instance.
# Import various Python libraries
import numpy as np
import pandas as pd
import matplotlib.pyplot as plt
import seaborn as sns
import time
!pip install plotly
import plotly.express as px
sns.set()
%matplotlib inline
Requirement already satisfied: plotly in c:\users\khsal\anaconda3\envs\fraud_env\lib\site-packages (4.14.3) Requirement already satisfied: retrying>=1.3.3 in c:\users\khsal\anaconda3\envs\fraud_env\lib\site-packages (from plotly) (1.3.3) Requirement already satisfied: six in c:\users\khsal\anaconda3\envs\fraud_env\lib\site-packages (from plotly) (1.15.0)
# Install imblearn
!pip install imbalanced-learn==0.7.0
!pip install imblearn
Collecting imbalanced-learn==0.7.0
Downloading imbalanced_learn-0.7.0-py3-none-any.whl (167 kB)
|████████████████████████████████| 167 kB 10.9 MB/s eta 0:00:01
Requirement already satisfied: scipy>=0.19.1 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn==0.7.0) (1.5.3)
Requirement already satisfied: joblib>=0.11 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn==0.7.0) (1.0.1)
Requirement already satisfied: numpy>=1.13.3 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn==0.7.0) (1.19.5)
Requirement already satisfied: scikit-learn>=0.23 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn==0.7.0) (0.24.1)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from scikit-learn>=0.23->imbalanced-learn==0.7.0) (2.1.0)
Installing collected packages: imbalanced-learn
Successfully installed imbalanced-learn-0.7.0
Collecting imblearn
Downloading imblearn-0.0-py2.py3-none-any.whl (1.9 kB)
Requirement already satisfied: imbalanced-learn in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imblearn) (0.7.0)
Requirement already satisfied: numpy>=1.13.3 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn->imblearn) (1.19.5)
Requirement already satisfied: scipy>=0.19.1 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn->imblearn) (1.5.3)
Requirement already satisfied: scikit-learn>=0.23 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn->imblearn) (0.24.1)
Requirement already satisfied: joblib>=0.11 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from imbalanced-learn->imblearn) (1.0.1)
Requirement already satisfied: threadpoolctl>=2.0.0 in /home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages (from scikit-learn>=0.23->imbalanced-learn->imblearn) (2.1.0)
Installing collected packages: imblearn
Successfully installed imblearn-0.0
# Check whether the file is already in the desired path or if it needs to be downloaded
# Data source: https://www.openml.org/data/get_csv/1673544/phpKo8OWT
import os
import subprocess
base_path = 'data/FraudDetection'
file_path = '/fraud.csv'
if not os.path.isfile(base_path + file_path):
subprocess.run(['mkdir', '-p', base_path])
print('dir made')
df = pd.read_csv('https://www.openml.org/data/get_csv/1673544/phpKo8OWT')
df.to_csv(base_path+file_path,index=False)
else:
print('File already downloaded!')
File already downloaded!
In this data preprocessing phase, you should take the opportunity to explore and visualize your data to better understand it. First, import the necessary libraries and read the data into a Pandas dataframe. After that, explore your data. Look for the shape of the dataset and explore your columns and the types of columns you're working with (numerical, categorical). Consider performing basic statistics on the features to get a sense of feature means and ranges. Take a close look at your target column and determine its distribution.
What can you deduce from the basic statistics you ran on the features?
What can you deduce from the distributions of the target classes?
Is there anything else you deduced from exploring the data?
df = pd.read_csv(base_path+file_path)
df.head(5)
| Time | V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | ... | V21 | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Class | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0.0 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | ... | -0.018307 | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | '0' |
| 1 | 0.0 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | ... | -0.225775 | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | '0' |
| 2 | 1.0 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | ... | 0.247998 | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | '0' |
| 3 | 1.0 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | ... | -0.108300 | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | '0' |
| 4 | 2.0 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | ... | -0.009431 | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | '0' |
5 rows × 31 columns
df.shape
(284807, 31)
df.duplicated().sum()
1081
df.drop_duplicates(inplace=True)
df.duplicated().any()
False
df.shape
(283726, 31)
Columns' type, Null values.
df.info()
<class 'pandas.core.frame.DataFrame'> Int64Index: 283726 entries, 0 to 284806 Data columns (total 31 columns): # Column Non-Null Count Dtype --- ------ -------------- ----- 0 Time 283726 non-null float64 1 V1 283726 non-null float64 2 V2 283726 non-null float64 3 V3 283726 non-null float64 4 V4 283726 non-null float64 5 V5 283726 non-null float64 6 V6 283726 non-null float64 7 V7 283726 non-null float64 8 V8 283726 non-null float64 9 V9 283726 non-null float64 10 V10 283726 non-null float64 11 V11 283726 non-null float64 12 V12 283726 non-null float64 13 V13 283726 non-null float64 14 V14 283726 non-null float64 15 V15 283726 non-null float64 16 V16 283726 non-null float64 17 V17 283726 non-null float64 18 V18 283726 non-null float64 19 V19 283726 non-null float64 20 V20 283726 non-null float64 21 V21 283726 non-null float64 22 V22 283726 non-null float64 23 V23 283726 non-null float64 24 V24 283726 non-null float64 25 V25 283726 non-null float64 26 V26 283726 non-null float64 27 V27 283726 non-null float64 28 V28 283726 non-null float64 29 Amount 283726 non-null float64 30 Class 283726 non-null object dtypes: float64(30), object(1) memory usage: 69.3+ MB
Class to integer.¶# The class has a weird string instead of a boolean or numbers 0 and 1, so convert it to 0 and 1
df['Class'] = df['Class'].str.strip("'").astype('int64')
# Check if that worked
df.head()
| Time | V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | ... | V21 | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Class | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 0.0 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | ... | -0.018307 | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | 0 |
| 1 | 0.0 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | ... | -0.225775 | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | 0 |
| 2 | 1.0 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | ... | 0.247998 | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | 0 |
| 3 | 1.0 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | ... | -0.108300 | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | 0 |
| 4 | 2.0 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | ... | -0.009431 | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | 0 |
5 rows × 31 columns
Task: Validate all the columns in the dataset and see that they are what you read above: V1-V28, Time, Amount, and Class.
df.columns
Index(['Time', 'V1', 'V2', 'V3', 'V4', 'V5', 'V6', 'V7', 'V8', 'V9', 'V10',
'V11', 'V12', 'V13', 'V14', 'V15', 'V16', 'V17', 'V18', 'V19', 'V20',
'V21', 'V22', 'V23', 'V24', 'V25', 'V26', 'V27', 'V28', 'Amount',
'Class'],
dtype='object')
df.describe()
| Time | V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | ... | V21 | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Class | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| count | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | ... | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 | 283726.000000 |
| mean | 94811.077600 | 0.005917 | -0.004135 | 0.001613 | -0.002966 | 0.001828 | -0.001139 | 0.001801 | -0.000854 | -0.001596 | ... | -0.000371 | -0.000015 | 0.000198 | 0.000214 | -0.000232 | 0.000149 | 0.001763 | 0.000547 | 88.472687 | 0.001667 |
| std | 47481.047891 | 1.948026 | 1.646703 | 1.508682 | 1.414184 | 1.377008 | 1.331931 | 1.227664 | 1.179054 | 1.095492 | ... | 0.723909 | 0.724550 | 0.623702 | 0.605627 | 0.521220 | 0.482053 | 0.395744 | 0.328027 | 250.399437 | 0.040796 |
| min | 0.000000 | -56.407510 | -72.715728 | -48.325589 | -5.683171 | -113.743307 | -26.160506 | -43.557242 | -73.216718 | -13.434066 | ... | -34.830382 | -10.933144 | -44.807735 | -2.836627 | -10.295397 | -2.604551 | -22.565679 | -15.430084 | 0.000000 | 0.000000 |
| 25% | 54204.750000 | -0.915951 | -0.600321 | -0.889682 | -0.850134 | -0.689830 | -0.769031 | -0.552509 | -0.208828 | -0.644221 | ... | -0.228305 | -0.542700 | -0.161703 | -0.354453 | -0.317485 | -0.326763 | -0.070641 | -0.052818 | 5.600000 | 0.000000 |
| 50% | 84692.500000 | 0.020384 | 0.063949 | 0.179963 | -0.022248 | -0.053468 | -0.275168 | 0.040859 | 0.021898 | -0.052596 | ... | -0.029441 | 0.006675 | -0.011159 | 0.041016 | 0.016278 | -0.052172 | 0.001479 | 0.011288 | 22.000000 | 0.000000 |
| 75% | 139298.000000 | 1.316068 | 0.800283 | 1.026960 | 0.739647 | 0.612218 | 0.396792 | 0.570474 | 0.325704 | 0.595977 | ... | 0.186194 | 0.528245 | 0.147748 | 0.439738 | 0.350667 | 0.240261 | 0.091208 | 0.078276 | 77.510000 | 0.000000 |
| max | 172792.000000 | 2.454930 | 22.057729 | 9.382558 | 16.875344 | 34.801666 | 73.301626 | 120.589494 | 20.007208 | 15.594995 | ... | 27.202839 | 10.503090 | 22.528412 | 4.584549 | 7.519589 | 3.517346 | 31.612198 | 33.847808 | 25691.160000 | 1.000000 |
8 rows × 31 columns
It seems that the
Amountis left skewed.
print("Fraud Statistics")
avg_amt = df.Amount.mean()
med_amt = df.Amount.quantile(0.5)
std_dev = df.Amount.std()
max_amt = df.Amount.max()
print(f"The average amount is {avg_amt}")
print(f"The median amount is {med_amt}")
print(f"The std deviation for amount is {std_dev}")
print(f"The max amount is {max_amt}")
Fraud Statistics The average amount is 88.47268731099724 The median amount is 22.0 The std deviation for amount is 250.39943711577337 The max amount is 25691.16
plt.figure(figsize=(12,6))
sns.histplot(df.Amount,bins=20);
plt.yscale('log')
Class.¶First, we can find out what the distribution is for it.
class_dis = df.Class.value_counts()
class_dis
0 283253 1 473 Name: Class, dtype: int64
class_dis[0]/df.shape[0]
0.9983328986416472
Fraud= 473
legitimate = 283253
Data is highly imbalanced
As we know this dataset contains transactions made by credit cards in September 2013.
We assume the first transaction happen in Monday, September 2, 2013 12:00:00 AM.
So the Epochtimestampis 1378080000.
Time to timestamp so we can convert it later to Date.¶# first transaction happen in Monday, September 2, 2013 12:00:00 AM.
refer_timestamp = 1378080000
df['Time'] = df['Time'].astype('int')+ refer_timestamp
df['Time'].head()
0 1378080000 1 1378080000 2 1378080001 3 1378080001 4 1378080002 Name: Time, dtype: int32
df['Time'] = df['Time'].apply(lambda x: pd.Timestamp(x,unit='s'))
df['Time']
0 2013-09-02 00:00:00
1 2013-09-02 00:00:00
2 2013-09-02 00:00:01
3 2013-09-02 00:00:01
4 2013-09-02 00:00:02
...
284802 2013-09-03 23:59:46
284803 2013-09-03 23:59:47
284804 2013-09-03 23:59:48
284805 2013-09-03 23:59:48
284806 2013-09-03 23:59:52
Name: Time, Length: 283726, dtype: datetime64[ns]
After looking at the distributions of features like Amount and Time, to what extend might those features help your model? Is there anything you can deduce from those distributions that might be helpful in better understanding your data?
Do the distributions of features like Amount and Time differ when you are looking only at data that is labeled as fraud?
Are there any features in your dataset that are strongly correlated? If so, what would be your next steps?
tran_time = df.set_index('Time')
tran_time = tran_time['Class'].resample('H').count()
tran_time = tran_time.reset_index()
tran_time.head()
| Time | Class | |
|---|---|---|
| 0 | 2013-09-02 00:00:00 | 3931 |
| 1 | 2013-09-02 01:00:00 | 2213 |
| 2 | 2013-09-02 02:00:00 | 1573 |
| 3 | 2013-09-02 03:00:00 | 1818 |
| 4 | 2013-09-02 04:00:00 | 1082 |
tran_time['Day'] = tran_time['Time'].dt.day.astype('str')
px.bar(data_frame=tran_time
,x='Time'
,y='Class'
,color='Day'
,title='Number of transaction for each day'.title()
)
plt.figure(figsize = (12,6))
sns.lineplot(data=tran_time
,x='Time'
,y='Class'
,hue='Day')
plt.title('Number of transactions timeline',fontdict={'size':'18'})
plt.ylabel('# transactions')
plt.show()
fraud_time = df.set_index('Time')
fraud_time = fraud_time['Class'].resample('H').sum()
fraud_time = fraud_time.reset_index()
fraud_time.head()
| Time | Class | |
|---|---|---|
| 0 | 2013-09-02 00:00:00 | 2 |
| 1 | 2013-09-02 01:00:00 | 2 |
| 2 | 2013-09-02 02:00:00 | 21 |
| 3 | 2013-09-02 03:00:00 | 13 |
| 4 | 2013-09-02 04:00:00 | 6 |
fraud_time['Day'] = fraud_time['Time'].dt.day.astype('str')
px.bar(data_frame=fraud_time
,x='Time'
,y='Class'
,color='Day'
,title='Number of Fraud transaction for each Day'.title()
)
plt.figure(figsize = (12,6))
sns.lineplot(data=fraud_time
,x='Time'
,y='Class'
,hue='Day')
plt.title('Fraud transaction timeline',fontdict={'size':'18'})
plt.show()
Distribution of Time differ when we are looking only at data that is labeled as fraud
As we see number of transactions is low at 12am to 6am, then it increase, in fraud case it's random no exact pattern here.
We neglict the
Day, and just consider thehour
df['Hour'] = df['Time'].dt.hour
df.head()
| Time | V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | ... | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Class | Hour | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | 2013-09-02 00:00:00 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | ... | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | 0 | 0 |
| 1 | 2013-09-02 00:00:00 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | ... | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | 0 | 0 |
| 2 | 2013-09-02 00:00:01 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | ... | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | 0 | 0 |
| 3 | 2013-09-02 00:00:01 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | ... | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | 0 | 0 |
| 4 | 2013-09-02 00:00:02 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | ... | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | 0 | 0 |
5 rows × 32 columns
df_hour = df.groupby(['Hour','Class']).agg({'Class':'count'})
df_hour.columns=['Num_trans']
df_hour = df_hour.reset_index()
df_hour.head()
| Hour | Class | Num_trans | |
|---|---|---|---|
| 0 | 0 | 0 | 7641 |
| 1 | 0 | 1 | 6 |
| 2 | 1 | 0 | 4198 |
| 3 | 1 | 1 | 10 |
| 4 | 2 | 0 | 3260 |
plt.figure(figsize=(12,6))
sns.barplot(data=df_hour
,x='Hour'
,y='Num_trans'
,hue='Class'
)
plt.yscale('log')
plt.title('Number of transaction per hour',fontdict={'size':'18'})
plt.show()
As we see the number of transactions starts increasing at 4:00 AM until it reach 10:00 PM, it begins to decrease again, but in fraud case as we mentioned earlier, it's random distribution and there is no exact pattern here.
night_hour = [16,17,18,19,20,21,22,23,24,0,1,2,3,4]
df_hour['Hour'].isin(night_hour)
print('Number of fraud at Day: ',df_hour.loc[(df_hour['Hour'].isin(night_hour)==False) & (df_hour['Class']==1),'Num_trans'].sum())
print('Number of fraud at Night: ',df_hour.loc[df_hour['Hour'].isin(night_hour)& df_hour['Class']==1,'Num_trans'].sum())
Number of fraud at Day: 212 Number of fraud at Night: 261
The fraud happen at both Day and night with small difference between them
It is not easy to differentiate the fraud and not fraud
px.histogram(df
,x='Amount'
,color='Class'
,log_y=True
,nbins=100
)
plt.figure(figsize=(12,6))
sns.histplot(data=df
,x='Amount'
,hue='Class'
,bins=30
)
plt.yscale('log')
plt.title('Distribution of Amount',fontdict={'size':'18'})
plt.show()
Distribution of Amount is still the same when we are looking only at data that is labeled as fraud
Now let's look at a distribution using a Seaborn function called pairplot. pairplot creates a grid of scatterplots, such that each feature in the dataset is used once as the X-axis and once as the Y-axis. The diagonal of this grid shows a distribution of the data for that feature.
Look at V1, V2, V2, V4, and Class pairplots. What do you see in the plots? Can you differentiate the fraud and not fraud from these features?
Hint: Create a new dataframe with columns V1, V2, V4, and Class.
new_df = df[['V1', 'V4', 'Hour','Amount', 'Class']]
sns.pairplot(new_df, hue="Class");
You can see for the smaller subset of the features that we used, there is a way to differentiate the fraud and not fraud,
but it's not easy to separate it based on any one feature.
plt.figure(figsize = (12,6))
plt.scatter(df.V1 , df.V2)
plt.xlabel('V1')
plt.ylabel('V2')
plt.title('Correlation between V1 and V2',fontdict={'size':'18'})
plt.show()
As we expected There is no Correlation between v1 and v2 as they generated by PCA.
plt.figure(figsize = (20,15))
correlation_matrix = df.corr()
sns.heatmap(correlation_matrix, annot=True,fmt=".2f")
plt.title('Correlation between all features',fontdict={'size':'18'})
plt.show()
There is no strong correlation here.
There are some preliminary steps that you have to include when converting the dataset from a DataFrame to a format that a machine learning algorithm can use. For Amazon SageMaker, here are the steps you need to take:
train_data, validation_data, and test_data using sklearn.model_selection.train_test_split. Note: If more than one role is required for notebook instances, training, and/or hosting, replace the get_execution_role() call with the appropriate full IAM role ARN string(s).
Replace <LabBucketName> with the resource name that you have.
import boto3
import sagemaker
from sagemaker import get_execution_role
from sagemaker.amazon.amazon_estimator import image_uris
from sagemaker.amazon.amazon_estimator import RecordSet
# Instantiate an Amazon SageMaker session
sess = sagemaker.Session()
# Get the Amazon SageMaker role
role = get_execution_role()
# Bucket name
bucket = <LabBucketName>
# Get the image URI for the container that includes the linear learner algorithm
container = image_uris.retrieve('linear-learner',boto3.Session().region_name)
print(f'Session {sess}')
print(f'The role is {role}')
print(f'The container is {role} in the {boto3.Session().region_name} region')
from sklearn.model_selection import train_test_split
def create_training_sets(df,target):
"""
Convert data frame to train, validation and test
params:
data: The dataframe with the dataset to be split
Returns:
train_features: Training feature dataset
test_features: Test feature dataset
train_labels: Labels for the training dataset
test_labels: Labels for the test dataset
val_features: Validation feature dataset
val_labels: Labels for the validation dataset
"""
df = df.sample(frac=1,random_state=42)
# Extract the target variable from the dataframe and convert the type to float32
ys = np.array(df[target]).astype("float32")
# Drop the target column from df and convert the data into a NumPy array of type float32
xs = np.array(df.drop(columns=target)).astype("float32")
np.random.seed(0)
# Use the sklearn function train_test_split to split the dataset in the ratio train 80% and test 20%
train_features, test_features, train_labels, test_labels = train_test_split(xs, ys, test_size=0.2)
# Use the sklearn function again to split the test dataset into 50% validation and 50% test
val_features, test_features, val_labels, test_labels = train_test_split(test_features, test_labels, test_size=0.5)
return train_features, test_features, train_labels, test_labels, val_features, val_labels
# Remove Time column as we have Hour now.
df.drop(columns='Time',inplace=True)
# Use the function to create your datasets
train_features, test_features, train_labels, test_labels, val_features, val_labels = create_training_sets(df,'Class')
print("Length of train_features is:", train_features.shape)
print("Length of train_labels is:" ,train_labels.shape)
print("Length of val_features is: ",val_features.shape)
print("Length of val_labels is: ",val_labels.shape)
print("Length of test_features is: ",test_features.shape)
print("Length of test_labels is: ",test_labels.shape)
Length of train_features is: (226980, 30) Length of train_labels is: (226980,) Length of val_features is: (28373, 30) Length of val_labels is: (28373,) Length of test_features is: (28373, 30) Length of test_labels is: (28373,)
Lets start by instantiating the LinearLearner estimator with predictor_type='binary_classifier' parameter with one ml.m4.xlarge instance.
# Instantiate the LinearLearner estimator 'binary classifier' object with one ml.m4.xlarge instance
linear = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
instance_count=1,
instance_type='ml.m5.xlarge',
predictor_type='binary_classifier')
Linear learner accepts training data in protobuf or CSV content types, and accepts inference requests in protobuf, CSV, or JSON content types.
Training data has features and ground-truth labels, while the data in an inference request has only features.
In a production pipeline, it is recommended to convert the data to the Amazon SageMaker protobuf format and store it in Amazon S3.
However, to get up and running quickly, AWS provides the convenient method record_set for converting and uploading when the dataset is small enough to fit in local memory. It accepts NumPy arrays like the ones you already have, so let's use it here
The RecordSet object will keep track of the temporary Amazon S3 location of your data.
Use the estimator.record_set function to create train, validation, and test records.
Then, use the estimator.fit function to start your training job.
### Create train, val, test records
train_records = linear.record_set(train_features, train_labels, channel='train')
val_records = linear.record_set(val_features, val_labels, channel='validation')
test_records = linear.record_set(test_features, test_labels, channel='test')
(<class 'sagemaker.amazon.amazon_estimator.RecordSet'>, {'s3_data': 's3://sagemaker-us-west-2-821202580419/sagemaker-record-sets/LinearLearner-2021-03-22-18-27-02-110/.amazon.manifest', 'feature_dim': 30, 'num_records': 226980, 's3_data_type': 'ManifestFile', 'channel': 'train'})
### Fit the classifier
linear.fit([train_records,val_records,test_records], wait=True, logs='All')
Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
In this section, you'll evaluate your trained model. First, use the estimator.deploy function with initial_instance_count= 1 and instance_type= 'ml.m4.xlarge' to deploy your model on Amazon SageMaker.
linear_predictor = linear.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge')
Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
---------------!
Now that you have a hosted endpoint running, you can make real-time predictions from the model easily by making an http POST request.
But first, you'll need to
set up
serializersanddeserializersfor passing yourtest_featuresNumPy arrays to the model behind the endpoint.
You will also calculate theconfusion matrixfor your model to evaluate how it has done on your test data visually.
from sklearn.metrics import accuracy_score,precision_score, recall_score
def predict_batches(model, features, labels, split=200):
"""
Predict datapoints in batches specified by the split.
The data will be split into <split> parts and model.predict is called
on each part
Arguments:
model: The model that you will use to call predict function
features: The dataset to predict on
labels: The true value of the records
split: Number of parts to split the data into
Returns:
None
"""
split_array = np.array_split(features, split)
predictions = []
for array in split_array:
predictions += model.predict(array)
preds = [i.label['predicted_label'].float32_tensor.values[0] for i in predictions]
# Calculate accuracy
accuracy = accuracy_score(labels, preds)
print(f'Accuracy: {accuracy}')
# Calculate precision
precision = precision_score(labels, preds)
print(f'Precision: {precision}')
# Calculate recall
recall = recall_score(labels, preds)
print(f'Recall: {recall}')
confusion_matrix = pd.crosstab(index=labels
, columns=np.round(preds)
, rownames=['True']
, colnames=['predictions']
).astype(int)
plt.figure(figsize = (5,5))
sns.heatmap(confusion_matrix
, annot=True
, fmt='.2f'
, cmap="YlGnBu"
).set_title('Confusion Matrix')
predict_batches(linear_predictor, test_features, test_labels)
Accuracy: 0.9992598597257957 Precision: 0.7659574468085106 Recall: 0.782608695652174
Similar to the test set, you can also look at the metrics for the training set. Keep in mind that those are also shown to you above in the logs.
predict_batches(linear_predictor, train_features, train_labels)
Accuracy: 0.999431667988369 Precision: 0.8600583090379009 Recall: 0.7845744680851063
It seem the same resulton test and training, we can deduce that the model is underfitting and still need to more learning/training.
Yes, the percesion is larger than the others, as the data imbalance it seem logically to get high value with percision than recall because if we have 1000 datapoints 100 Fraud and 900 not fraud at the worst case if the model predict all as not fraud the accuracy will be 90% and recall/percsion will be 0.

Recall, as the cost of predicting someone not Fraud although he is, more than predicting someone fraud and he is'nt.
No, Try to resample the dataset, remove correlation if exist and try to rescale the features.
# Delete inference endpoint
sagemaker.Session().delete_endpoint(linear_predictor.endpoint)
The endpoint attribute has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.
You've now gone through one iteration of training and evaluating your model. Given that the outcome you reached for your model the first time probably wasn't sufficient for solving your business problem, what are some things you could change about your data to possibly improve model performance?
The accuracy is calculated with how many examples the model got right. However, most of the examples are actually negative, so if you actually predict all examples as zero in this very imbalanced dataset, you can still get an accuracy of about 99.827%. Having an imbalanced dataset may cause some problems with algorithm performance. So it's useful to treat the imbalance in the data before you train the model.
Question: How do you solve the problem of dataset imbalance?
Use sns.countplot to plot the original distribution of the dataset.
sns.countplot(df['Class'])
plt.yscale('log')
plt.title('Original Distribution of the dataset')
/home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/seaborn/_decorators.py:43: FutureWarning: Pass the following variable as a keyword arg: x. From version 0.12, the only valid positional argument will be `data`, and passing other arguments without an explicit keyword will result in an error or misinterpretation.
Text(0.5, 1.0, 'Original Distribution of the dataset')
Convert train_features back into a DataFrame.
df.columns
Index(['V1', 'V2', 'V3', 'V4', 'V5', 'V6', 'V7', 'V8', 'V9', 'V10', 'V11',
'V12', 'V13', 'V14', 'V15', 'V16', 'V17', 'V18', 'V19', 'V20', 'V21',
'V22', 'V23', 'V24', 'V25', 'V26', 'V27', 'V28', 'Amount', 'Class',
'Hour'],
dtype='object')
df_train = df
df_train.rename(columns={'Class':'Target'}
,inplace=True)
df_train.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | V10 | ... | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Target | Hour | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | 0.090794 | ... | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | 0 | 0 |
| 1 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | -0.166974 | ... | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | 0 | 0 |
| 2 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | 0.207643 | ... | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | 0 | 0 |
| 3 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | -0.054952 | ... | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | 0 | 0 |
| 4 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | 0.753074 | ... | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | 0 | 0 |
5 rows × 31 columns
There are two main ways to handle imbalanced datasets:
You can use a library called Imbalanced-learn for sampling the datasets. imbalanced-learn is a Python package offering a number of resampling techniques commonly used in datasets showing strong between-class imbalance. It is compatible with scikit-learn and is part of scikit-learn-contrib projects. For more information, see imbalanced-learn API documentation.
Choose undersampling for this example first. To create the balanced dataset:
fraud_df with all the positive examples.non_fraud_df and use dataframe.sample with the same number as the fraud_df DataFrame and random_state=235.balanced_df.# Select the rows in df_train dataframe where Target == 1
fraud_df = df_train[df_train.Target==1]
# Select the rows in df_train dataframe where Target == 0
non_fraud_df = df_train[df_train.Target==0].sample(n=fraud_df.shape[0]) # Enter your code here
balanced_df = pd.concat([fraud_df, non_fraud_df], ignore_index=True, sort=False)
balanced_df.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | V10 | ... | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Target | Hour | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | -2.312227 | 1.951992 | -1.609851 | 3.997906 | -0.522188 | -1.426545 | -2.537387 | 1.391657 | -2.770089 | -2.772272 | ... | -0.035049 | -0.465211 | 0.320198 | 0.044519 | 0.177840 | 0.261145 | -0.143276 | 0.00 | 1 | 0 |
| 1 | -3.043541 | -3.157307 | 1.088463 | 2.288644 | 1.359805 | -1.064823 | 0.325574 | -0.067794 | -0.270953 | -0.838587 | ... | 0.435477 | 1.375966 | -0.293803 | 0.279798 | -0.145362 | -0.252773 | 0.035764 | 529.00 | 1 | 0 |
| 2 | -2.303350 | 1.759247 | -0.359745 | 2.330243 | -0.821628 | -0.075788 | 0.562320 | -0.399147 | -0.238253 | -1.525412 | ... | -0.932391 | 0.172726 | -0.087330 | -0.156114 | -0.542628 | 0.039566 | -0.153029 | 239.93 | 1 | 1 |
| 3 | -4.397974 | 1.358367 | -2.592844 | 2.679787 | -1.128131 | -1.706536 | -3.496197 | -0.248778 | -0.247768 | -4.801637 | ... | 0.176968 | -0.436207 | -0.053502 | 0.252405 | -0.657488 | -0.827136 | 0.849573 | 59.00 | 1 | 1 |
| 4 | 1.234235 | 3.019740 | -4.304597 | 4.732795 | 3.624201 | -1.357746 | 1.713445 | -0.496358 | -1.282858 | -2.447469 | ... | -0.704181 | -0.656805 | -1.632653 | 1.488901 | 0.566797 | -0.010016 | 0.146793 | 1.00 | 1 | 2 |
5 rows × 31 columns
Check the distribution and shape again using sns.countplot().
sns.countplot(balanced_df['Target'])
plt.title('Original Distribution of the dataset')
plt.show()
/home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/seaborn/_decorators.py:43: FutureWarning: Pass the following variable as a keyword arg: x. From version 0.12, the only valid positional argument will be `data`, and passing other arguments without an explicit keyword will result in an error or misinterpretation.
balanced_df.shape
(946, 31)
balanced_df.duplicated().sum()
0
Before looking at the training, look at what will happen if you use a feature reduction technique like t-Distributed Stochastic Neighbor Embedding (t-SNE) on the dataset.
from sklearn.manifold import TSNE
X_embedded = TSNE(n_components=2).fit_transform(balanced_df.drop(columns=['Target']))
X_embedded.shape
(946, 2)
from matplotlib.colors import ListedColormap
plt.figure(figsize = (10,10))
plt.scatter(X_embedded[:,0], X_embedded[:,1],
c = balanced_df['Target'],
s = 1,
cmap = ListedColormap(['Red', 'Blue']),
linewidths=1)
plt.title('Red: 0 , Blue: 1')
Text(0.5, 1.0, 'Red: 0 , Blue: 1')
Question: Does t-SNE help you differentiate the fraud from not fraud?
Answer: t-SNE can differentiate between some of the fraud and not fraud cases, but it doesn't do a good job of completely differentiating the two when we reduce the data to just two dimensions.
Now that you have the new data, compare what the correlation matrix looks like before and after.
# Make sure to use the subsample in the correlation
plt.figure(figsize = (20,10))
# Use the original dataset to find the correlations between the features
correlation_matrix_before = df_train.corr()
sns.heatmap(correlation_matrix_before, annot=True,fmt=".2f")
plt.title('Correlation before balance',fontdict={'size':'18'})
plt.show()
plt.figure(figsize = (20,10))
# Use the original dataset to find the correlations between the features
correlation_matrix_after = balanced_df.corr()# Enter your code here
sns.heatmap(correlation_matrix_after, annot=True,fmt=".2f")
plt.title('Correlation After balance',fontdict={'size':'18'})
plt.show()
Question: What can you deduce from looking at the different correlation matrices? If you see a difference, can you analyze why there is a difference?
Answer: In the unbalanced set, the correlation matrix didn't show any linear relationships, but in this smaller balanced dataset, you can see some linear relationships.
Question: Would you drop any columns because of the correlated data?
Answer: Yes, remove any features that have more than 85% correlation.
def remove_corr(df,thresh=0.85):
"""
remove_corr(df,thresh=0.85):
return columns with thresh correlation to drop
Parameters:
df: dataframe
correlation_matrix
thresh: float
correlation threshold
return columns' name to be droped
"""
removed_col=set()
for col in df.columns:
if col in removed_col:
continue
else:
upper_thresh = (df[col]>=thresh)&(df[col]<1)
lowwer_thresh = (df[col]<=-1*thresh) & (df[col]>-1)
idx = np.where(upper_thresh | lowwer_thresh)
temp = df.iloc[idx].index
if len(temp):
removed_col.update(list(temp))
return removed_col
drop_col = remove_corr(correlation_matrix_after,0.89)
drop_col
{'V12', 'V17', 'V18'}
Because there are some correlations, let's remove the correlated data that has more than 0.89 correlation.
balanced_df_drop = balanced_df.drop(columns=drop_col)
balanced_df_drop.shape
(946, 28)
Now it's time to train, deploy, and evaluate using the new balanced dataset.
# Use the function to create your datasets
train_features, test_features, train_labels, test_labels, val_features, val_labels = create_training_sets(balanced_df_drop,'Target')
print("Length of train_features is:", train_features.shape)
print("Length of train_labels is:" ,train_labels.shape)
print("Length of val_features is: ",val_features.shape)
print("Length of val_labels is: ",val_labels.shape)
print("Length of test_features is: ",test_features.shape)
print("Length of test_labels is: ",test_labels.shape)
Length of train_features is: (756, 27) Length of train_labels is: (756,) Length of val_features is: (95, 27) Length of val_labels is: (95,) Length of test_features is: (95, 27) Length of test_labels is: (95,)
linear_estimator_balanced = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
instance_count=1,
instance_type='ml.m4.xlarge',
predictor_type='binary_classifier')
train_records_bal = linear_estimator_balanced.record_set(train_features, train_labels, channel='train')
val_records_bal = linear_estimator_balanced.record_set(val_features, val_labels, channel='validation')
test_records_bal = linear_estimator_balanced.record_set(test_features, test_labels, channel='test')
linear_estimator_balanced.fit([train_records_bal, val_records_bal, test_records_bal])
Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
2021-03-22 19:45:39 Starting - Starting the training job... 2021-03-22 19:46:04 Starting - Launching requested ML instancesProfilerReport-1616442338: InProgress ......... 2021-03-22 19:47:24 Starting - Preparing the instances for training...... 2021-03-22 19:48:39 Downloading - Downloading input data...... 2021-03-22 19:49:40 Training - Training image download completed. Training in progress..Docker entrypoint called with argument(s): train Running default environment configuration script [03/22/2021 19:49:45 INFO 140389653051200] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'} [03/22/2021 19:49:45 INFO 140389653051200] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'feature_dim': '27', 'predictor_type': 'binary_classifier', 'mini_batch_size': '756'} [03/22/2021 19:49:45 INFO 140389653051200] Final configuration: {'mini_batch_size': '756', 'epochs': '15', 'feature_dim': '27', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'} [03/22/2021 19:49:45 WARNING 140389653051200] Loggers have already been setup. Process 1 is a worker. [03/22/2021 19:49:45 INFO 140389653051200] Using default worker. [03/22/2021 19:49:45 INFO 140389653051200] Checkpoint loading and saving are disabled. [2021-03-22 19:49:45.450] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 19:49:45.450] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 19:49:45.466] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 0, "duration": 18, "num_examples": 1, "num_bytes": 114912} [03/22/2021 19:49:45 INFO 140389653051200] Create Store: local [2021-03-22 19:49:45.494] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 1, "duration": 27, "num_examples": 1, "num_bytes": 114912} [03/22/2021 19:49:45 INFO 140389653051200] Scaler algorithm parameters <algorithm.scaler.ScalerAlgorithmStable object at 0x7faea2b30510> [03/22/2021 19:49:45 INFO 140389653051200] Scaling model computed with parameters: {'stdev_label': None, 'stdev_weight': [ 5.4136133 3.6351695 6.070851 3.137778 4.1863217 1.7152078 5.4310737 4.15461 2.216961 4.182414 2.7050896 1.0677243 4.5392647 0.96763366 3.3654432 1.2621558 1.0146897 2.013982 0.9741087 1.1886685 0.54931307 0.67861325 0.5123765 0.87638724 0.41912386 227.6439 6.3508825 ] <NDArray 27 @cpu(0)>, 'mean_label': None, 'mean_weight': [-2.31505752e+00 1.67478538e+00 -3.29822397e+00 2.23108768e+00 -1.52447593e+00 -7.14400649e-01 -2.60207605e+00 5.36633253e-01 -1.26461542e+00 -2.67884803e+00 1.84269726e+00 -3.23295519e-02 -3.32113957e+00 9.93338972e-03 -1.97918248e+00 3.21574032e-01 1.87673956e-01 2.93485731e-01 3.73432413e-03 -7.19649717e-02 -4.06053402e-02 4.09610309e-02 5.14877103e-02 1.25564069e-01 3.19285914e-02 1.08336464e+02 1.29523811e+01] <NDArray 27 @cpu(0)>} [03/22/2021 19:49:45 INFO 140389653051200] nvidia-smi took: 0.025275707244873047 secs to identify 0 gpus [03/22/2021 19:49:45 INFO 140389653051200] Number of GPUs being used: 0 #metrics {"StartTime": 1616442585.6134305, "EndTime": 1616442585.613473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "init_train_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1512.0, "count": 1, "min": 1512, "max": 1512}, "Total Batches Seen": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Number of Records Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}, "Number of Batches Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}}} [2021-03-22 19:49:45.675] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 4, "duration": 61, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442585.6753209, "EndTime": 1616442585.675427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7162877642919147, "count": 1, "min": 0.7162877642919147, "max": 0.7162877642919147}}} #metrics {"StartTime": 1616442585.6755354, "EndTime": 1616442585.6755579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7643548874627977, "count": 1, "min": 0.7643548874627977, "max": 0.7643548874627977}}} #metrics {"StartTime": 1616442585.6756225, "EndTime": 1616442585.6756415, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7613329206194196, "count": 1, "min": 0.7613329206194196, "max": 0.7613329206194196}}} #metrics {"StartTime": 1616442585.675704, "EndTime": 1616442585.6757245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.673351630962715, "count": 1, "min": 0.673351630962715, "max": 0.673351630962715}}} #metrics {"StartTime": 1616442585.675794, "EndTime": 1616442585.6758146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6754376850430928, "count": 1, "min": 0.6754376850430928, "max": 0.6754376850430928}}} #metrics {"StartTime": 1616442585.6758783, "EndTime": 1616442585.6758983, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6918557787698413, "count": 1, "min": 0.6918557787698413, "max": 0.6918557787698413}}} #metrics {"StartTime": 1616442585.6759603, "EndTime": 1616442585.6759787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.730355076058201, "count": 1, "min": 0.730355076058201, "max": 0.730355076058201}}} #metrics {"StartTime": 1616442585.6760378, "EndTime": 1616442585.6760542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6498514811197916, "count": 1, "min": 0.6498514811197916, "max": 0.6498514811197916}}} #metrics {"StartTime": 1616442585.6761003, "EndTime": 1616442585.676118, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7018376103153935, "count": 1, "min": 0.7018376103153935, "max": 0.7018376103153935}}} #metrics {"StartTime": 1616442585.6761758, "EndTime": 1616442585.676194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6578898354182168, "count": 1, "min": 0.6578898354182168, "max": 0.6578898354182168}}} #metrics {"StartTime": 1616442585.676251, "EndTime": 1616442585.6762686, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7861937669219163, "count": 1, "min": 0.7861937669219163, "max": 0.7861937669219163}}} #metrics {"StartTime": 1616442585.6763122, "EndTime": 1616442585.6763272, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7136455717540923, "count": 1, "min": 0.7136455717540923, "max": 0.7136455717540923}}} #metrics {"StartTime": 1616442585.6763816, "EndTime": 1616442585.6764, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7275435028883516, "count": 1, "min": 0.7275435028883516, "max": 0.7275435028883516}}} #metrics {"StartTime": 1616442585.676468, "EndTime": 1616442585.6764865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.616089593796503, "count": 1, "min": 0.616089593796503, "max": 0.616089593796503}}} #metrics {"StartTime": 1616442585.6765425, "EndTime": 1616442585.6765597, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.8024727150245949, "count": 1, "min": 0.8024727150245949, "max": 0.8024727150245949}}} #metrics {"StartTime": 1616442585.6766155, "EndTime": 1616442585.6766338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6562846350291419, "count": 1, "min": 0.6562846350291419, "max": 0.6562846350291419}}} #metrics {"StartTime": 1616442585.6766884, "EndTime": 1616442585.6767075, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6610952710348462, "count": 1, "min": 0.6610952710348462, "max": 0.6610952710348462}}} #metrics {"StartTime": 1616442585.676763, "EndTime": 1616442585.67678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.691109470589451, "count": 1, "min": 0.691109470589451, "max": 0.691109470589451}}} #metrics {"StartTime": 1616442585.676836, "EndTime": 1616442585.6768508, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6575244318240534, "count": 1, "min": 0.6575244318240534, "max": 0.6575244318240534}}} #metrics {"StartTime": 1616442585.6769066, "EndTime": 1616442585.6769242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6977010252614501, "count": 1, "min": 0.6977010252614501, "max": 0.6977010252614501}}} #metrics {"StartTime": 1616442585.6769974, "EndTime": 1616442585.6770155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7567619848503637, "count": 1, "min": 0.7567619848503637, "max": 0.7567619848503637}}} #metrics {"StartTime": 1616442585.6770818, "EndTime": 1616442585.6771011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7058729545149223, "count": 1, "min": 0.7058729545149223, "max": 0.7058729545149223}}} #metrics {"StartTime": 1616442585.677161, "EndTime": 1616442585.6771793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6700650169735863, "count": 1, "min": 0.6700650169735863, "max": 0.6700650169735863}}} #metrics {"StartTime": 1616442585.677238, "EndTime": 1616442585.6772528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.758200589941923, "count": 1, "min": 0.758200589941923, "max": 0.758200589941923}}} #metrics {"StartTime": 1616442585.6773221, "EndTime": 1616442585.6773417, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6352383648907697, "count": 1, "min": 0.6352383648907697, "max": 0.6352383648907697}}} #metrics {"StartTime": 1616442585.6774118, "EndTime": 1616442585.6774318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.77992837895792, "count": 1, "min": 0.77992837895792, "max": 0.77992837895792}}} #metrics {"StartTime": 1616442585.6774848, "EndTime": 1616442585.6775012, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6785831350498098, "count": 1, "min": 0.6785831350498098, "max": 0.6785831350498098}}} #metrics {"StartTime": 1616442585.6775534, "EndTime": 1616442585.6775713, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6348462382321636, "count": 1, "min": 0.6348462382321636, "max": 0.6348462382321636}}} #metrics {"StartTime": 1616442585.6776216, "EndTime": 1616442585.6776376, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7205700748181217, "count": 1, "min": 0.7205700748181217, "max": 0.7205700748181217}}} #metrics {"StartTime": 1616442585.677691, "EndTime": 1616442585.677709, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.8214251805865576, "count": 1, "min": 0.8214251805865576, "max": 0.8214251805865576}}} #metrics {"StartTime": 1616442585.6777592, "EndTime": 1616442585.677779, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7556044159742891, "count": 1, "min": 0.7556044159742891, "max": 0.7556044159742891}}} #metrics {"StartTime": 1616442585.6778164, "EndTime": 1616442585.6778305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6977965339781746, "count": 1, "min": 0.6977965339781746, "max": 0.6977965339781746}}} [03/22/2021 19:49:45 INFO 140389653051200] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.7162877642919147 [2021-03-22 19:49:45.712] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 0, "duration": 262, "num_examples": 1, "num_bytes": 14440} [2021-03-22 19:49:45.882] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 2, "duration": 169, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442586.099475, "EndTime": 1616442586.0995934, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7061385305304276, "count": 1, "min": 0.7061385305304276, "max": 0.7061385305304276}}} #metrics {"StartTime": 1616442586.099713, "EndTime": 1616442586.0997345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7504327071340461, "count": 1, "min": 0.7504327071340461, "max": 0.7504327071340461}}} #metrics {"StartTime": 1616442586.0997906, "EndTime": 1616442586.0998065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7344389262952302, "count": 1, "min": 0.7344389262952302, "max": 0.7344389262952302}}} #metrics {"StartTime": 1616442586.0998569, "EndTime": 1616442586.0998726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6511787816097862, "count": 1, "min": 0.6511787816097862, "max": 0.6511787816097862}}} #metrics {"StartTime": 1616442586.0999198, "EndTime": 1616442586.0999348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5922027186343545, "count": 1, "min": 0.5922027186343545, "max": 0.5922027186343545}}} #metrics {"StartTime": 1616442586.0999844, "EndTime": 1616442586.1000028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5855452286569696, "count": 1, "min": 0.5855452286569696, "max": 0.5855452286569696}}} #metrics {"StartTime": 1616442586.1000562, "EndTime": 1616442586.1000729, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6088213468852796, "count": 1, "min": 0.6088213468852796, "max": 0.6088213468852796}}} #metrics {"StartTime": 1616442586.100128, "EndTime": 1616442586.1001437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5789482116699218, "count": 1, "min": 0.5789482116699218, "max": 0.5789482116699218}}} #metrics {"StartTime": 1616442586.1001916, "EndTime": 1616442586.1002064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6769147370990954, "count": 1, "min": 0.6769147370990954, "max": 0.6769147370990954}}} #metrics {"StartTime": 1616442586.1002533, "EndTime": 1616442586.1002684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6326856111225329, "count": 1, "min": 0.6326856111225329, "max": 0.6326856111225329}}} #metrics {"StartTime": 1616442586.1003165, "EndTime": 1616442586.1003332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7718715466951069, "count": 1, "min": 0.7718715466951069, "max": 0.7718715466951069}}} #metrics {"StartTime": 1616442586.100386, "EndTime": 1616442586.1004012, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6984146921258224, "count": 1, "min": 0.6984146921258224, "max": 0.6984146921258224}}} #metrics {"StartTime": 1616442586.1004562, "EndTime": 1616442586.1004727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6157361883866159, "count": 1, "min": 0.6157361883866159, "max": 0.6157361883866159}}} #metrics {"StartTime": 1616442586.100526, "EndTime": 1616442586.1005425, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5649428518194901, "count": 1, "min": 0.5649428518194901, "max": 0.5649428518194901}}} #metrics {"StartTime": 1616442586.100596, "EndTime": 1616442586.1006117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6477253160978619, "count": 1, "min": 0.6477253160978619, "max": 0.6477253160978619}}} #metrics {"StartTime": 1616442586.100665, "EndTime": 1616442586.1006823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5859197917737459, "count": 1, "min": 0.5859197917737459, "max": 0.5859197917737459}}} #metrics {"StartTime": 1616442586.1007347, "EndTime": 1616442586.1007507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6521406474866365, "count": 1, "min": 0.6521406474866365, "max": 0.6521406474866365}}} #metrics {"StartTime": 1616442586.1008043, "EndTime": 1616442586.10082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842767012746711, "count": 1, "min": 0.6842767012746711, "max": 0.6842767012746711}}} #metrics {"StartTime": 1616442586.100876, "EndTime": 1616442586.1008914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6327321102744654, "count": 1, "min": 0.6327321102744654, "max": 0.6327321102744654}}} #metrics {"StartTime": 1616442586.1009398, "EndTime": 1616442586.100956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6563981307180304, "count": 1, "min": 0.6563981307180304, "max": 0.6563981307180304}}} #metrics {"StartTime": 1616442586.1010048, "EndTime": 1616442586.101019, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6057764153731496, "count": 1, "min": 0.6057764153731496, "max": 0.6057764153731496}}} #metrics {"StartTime": 1616442586.1010716, "EndTime": 1616442586.101089, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5743457593415913, "count": 1, "min": 0.5743457593415913, "max": 0.5743457593415913}}} #metrics {"StartTime": 1616442586.1011436, "EndTime": 1616442586.101161, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5878449289422286, "count": 1, "min": 0.5878449289422286, "max": 0.5878449289422286}}} #metrics {"StartTime": 1616442586.101216, "EndTime": 1616442586.1012318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5992850052682976, "count": 1, "min": 0.5992850052682976, "max": 0.5992850052682976}}} #metrics {"StartTime": 1616442586.1012857, "EndTime": 1616442586.1013029, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6325756675318668, "count": 1, "min": 0.6325756675318668, "max": 0.6325756675318668}}} #metrics {"StartTime": 1616442586.1013572, "EndTime": 1616442586.1013737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7603398373252467, "count": 1, "min": 0.7603398373252467, "max": 0.7603398373252467}}} #metrics {"StartTime": 1616442586.1014264, "EndTime": 1616442586.1014426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6706635324578536, "count": 1, "min": 0.6706635324578536, "max": 0.6706635324578536}}} #metrics {"StartTime": 1616442586.101497, "EndTime": 1616442586.1015134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6327137595728825, "count": 1, "min": 0.6327137595728825, "max": 0.6327137595728825}}} #metrics {"StartTime": 1616442586.101568, "EndTime": 1616442586.1015832, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.8448895103053042, "count": 1, "min": 0.8448895103053042, "max": 0.8448895103053042}}} #metrics {"StartTime": 1616442586.1016345, "EndTime": 1616442586.1016512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7510494031404195, "count": 1, "min": 0.7510494031404195, "max": 0.7510494031404195}}} #metrics {"StartTime": 1616442586.1017013, "EndTime": 1616442586.1017165, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7418767828690378, "count": 1, "min": 0.7418767828690378, "max": 0.7418767828690378}}} #metrics {"StartTime": 1616442586.1017718, "EndTime": 1616442586.101789, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.8071672138414885, "count": 1, "min": 0.8071672138414885, "max": 0.8071672138414885}}} [03/22/2021 19:49:46 INFO 140389653051200] #quality_metric: host=algo-1, epoch=0, validation binary_classification_cross_entropy_objective <loss>=0.7061385305304276 [03/22/2021 19:49:46 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=sampled_accuracy, value=0.9052631578948366 [03/22/2021 19:49:46 INFO 140389653051200] Epoch 0: Loss improved. Updating best model [03/22/2021 19:49:46 INFO 140389653051200] Saving model for epoch: 0 [03/22/2021 19:49:46 INFO 140389653051200] Saved checkpoint to "/tmp/tmpnoibgiqs/mx-mod-0000.params" [03/22/2021 19:49:46 INFO 140389653051200] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs #metrics {"StartTime": 1616442585.6137955, "EndTime": 1616442586.1136563, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2268.0, "count": 1, "min": 2268, "max": 2268}, "Total Batches Seen": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:46 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1511.950975100371 records/second [2021-03-22 19:49:46.167] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 6, "duration": 53, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442586.1678388, "EndTime": 1616442586.1680582, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6953502029338211, "count": 1, "min": 0.6953502029338211, "max": 0.6953502029338211}}} #metrics {"StartTime": 1616442586.1681688, "EndTime": 1616442586.168193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7415492143580522, "count": 1, "min": 0.7415492143580522, "max": 0.7415492143580522}}} #metrics {"StartTime": 1616442586.1682937, "EndTime": 1616442586.1683156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7380715022011409, "count": 1, "min": 0.7380715022011409, "max": 0.7380715022011409}}} #metrics {"StartTime": 1616442586.1684256, "EndTime": 1616442586.1684473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6542859354977886, "count": 1, "min": 0.6542859354977886, "max": 0.6542859354977886}}} #metrics {"StartTime": 1616442586.1685383, "EndTime": 1616442586.168558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.549465643665778, "count": 1, "min": 0.549465643665778, "max": 0.549465643665778}}} #metrics {"StartTime": 1616442586.168651, "EndTime": 1616442586.1686711, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5561503657588253, "count": 1, "min": 0.5561503657588253, "max": 0.5561503657588253}}} #metrics {"StartTime": 1616442586.1687295, "EndTime": 1616442586.1687806, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5698956282681258, "count": 1, "min": 0.5698956282681258, "max": 0.5698956282681258}}} #metrics {"StartTime": 1616442586.1688426, "EndTime": 1616442586.1688986, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5414686253461888, "count": 1, "min": 0.5414686253461888, "max": 0.5414686253461888}}} #metrics {"StartTime": 1616442586.1689696, "EndTime": 1616442586.1690207, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6821530458157655, "count": 1, "min": 0.6821530458157655, "max": 0.6821530458157655}}} #metrics {"StartTime": 1616442586.1690853, "EndTime": 1616442586.1691396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6395789252387153, "count": 1, "min": 0.6395789252387153, "max": 0.6395789252387153}}} #metrics {"StartTime": 1616442586.1692204, "EndTime": 1616442586.1692402, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7629746532944776, "count": 1, "min": 0.7629746532944776, "max": 0.7629746532944776}}} #metrics {"StartTime": 1616442586.16933, "EndTime": 1616442586.169347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6930288486379795, "count": 1, "min": 0.6930288486379795, "max": 0.6930288486379795}}} #metrics {"StartTime": 1616442586.1693997, "EndTime": 1616442586.169419, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5647691595491278, "count": 1, "min": 0.5647691595491278, "max": 0.5647691595491278}}} #metrics {"StartTime": 1616442586.1695158, "EndTime": 1616442586.1695352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.530413753771908, "count": 1, "min": 0.530413753771908, "max": 0.530413753771908}}} #metrics {"StartTime": 1616442586.1696272, "EndTime": 1616442586.1696496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5914773285073578, "count": 1, "min": 0.5914773285073578, "max": 0.5914773285073578}}} #metrics {"StartTime": 1616442586.1697078, "EndTime": 1616442586.169761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5449452879567626, "count": 1, "min": 0.5449452879567626, "max": 0.5449452879567626}}} #metrics {"StartTime": 1616442586.169832, "EndTime": 1616442586.1698804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6439518196872933, "count": 1, "min": 0.6439518196872933, "max": 0.6439518196872933}}} #metrics {"StartTime": 1616442586.1699417, "EndTime": 1616442586.1700082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6727123361415964, "count": 1, "min": 0.6727123361415964, "max": 0.6727123361415964}}} #metrics {"StartTime": 1616442586.1700966, "EndTime": 1616442586.1701322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6395413030392278, "count": 1, "min": 0.6395413030392278, "max": 0.6395413030392278}}} #metrics {"StartTime": 1616442586.1702046, "EndTime": 1616442586.1702247, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6781221420045883, "count": 1, "min": 0.6781221420045883, "max": 0.6781221420045883}}} #metrics {"StartTime": 1616442586.1702914, "EndTime": 1616442586.170349, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5775682964022197, "count": 1, "min": 0.5775682964022197, "max": 0.5775682964022197}}} #metrics {"StartTime": 1616442586.170447, "EndTime": 1616442586.1704695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5547473241412451, "count": 1, "min": 0.5547473241412451, "max": 0.5547473241412451}}} #metrics {"StartTime": 1616442586.1705453, "EndTime": 1616442586.170581, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5664012444713128, "count": 1, "min": 0.5664012444713128, "max": 0.5664012444713128}}} #metrics {"StartTime": 1616442586.1706452, "EndTime": 1616442586.1706626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5751036386641245, "count": 1, "min": 0.5751036386641245, "max": 0.5751036386641245}}} #metrics {"StartTime": 1616442586.1707513, "EndTime": 1616442586.1707716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6417033684947503, "count": 1, "min": 0.6417033684947503, "max": 0.6417033684947503}}} #metrics {"StartTime": 1616442586.1708682, "EndTime": 1616442586.1708884, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7688589752035797, "count": 1, "min": 0.7688589752035797, "max": 0.7688589752035797}}} #metrics {"StartTime": 1616442586.1709807, "EndTime": 1616442586.1710005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6793539864676339, "count": 1, "min": 0.6793539864676339, "max": 0.6793539864676339}}} #metrics {"StartTime": 1616442586.1711032, "EndTime": 1616442586.171125, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6384605932488012, "count": 1, "min": 0.6384605932488012, "max": 0.6384605932488012}}} #metrics {"StartTime": 1616442586.171213, "EndTime": 1616442586.1712322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.8530442979600694, "count": 1, "min": 0.8530442979600694, "max": 0.8530442979600694}}} #metrics {"StartTime": 1616442586.1712952, "EndTime": 1616442586.171341, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.734448064571966, "count": 1, "min": 0.734448064571966, "max": 0.734448064571966}}} #metrics {"StartTime": 1616442586.171405, "EndTime": 1616442586.1714473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.746154542953249, "count": 1, "min": 0.746154542953249, "max": 0.746154542953249}}} #metrics {"StartTime": 1616442586.171513, "EndTime": 1616442586.1715307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.8153184355882109, "count": 1, "min": 0.8153184355882109, "max": 0.8153184355882109}}} [03/22/2021 19:49:46 INFO 140389653051200] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.6953502029338211 [2021-03-22 19:49:46.354] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 5, "duration": 151, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442586.562576, "EndTime": 1616442586.562654, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6869888305664062, "count": 1, "min": 0.6869888305664062, "max": 0.6869888305664062}}} #metrics {"StartTime": 1616442586.5627477, "EndTime": 1616442586.5627656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7300295378032483, "count": 1, "min": 0.7300295378032483, "max": 0.7300295378032483}}} #metrics {"StartTime": 1616442586.562803, "EndTime": 1616442586.5628202, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7145588121916119, "count": 1, "min": 0.7145588121916119, "max": 0.7145588121916119}}} #metrics {"StartTime": 1616442586.5628707, "EndTime": 1616442586.5628881, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6341441104286596, "count": 1, "min": 0.6341441104286596, "max": 0.6341441104286596}}} #metrics {"StartTime": 1616442586.5629373, "EndTime": 1616442586.5629528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41502709639699836, "count": 1, "min": 0.41502709639699836, "max": 0.41502709639699836}}} #metrics {"StartTime": 1616442586.563005, "EndTime": 1616442586.5630233, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4028399818821957, "count": 1, "min": 0.4028399818821957, "max": 0.4028399818821957}}} #metrics {"StartTime": 1616442586.5630796, "EndTime": 1616442586.5630991, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41844337864925985, "count": 1, "min": 0.41844337864925985, "max": 0.41844337864925985}}} #metrics {"StartTime": 1616442586.563152, "EndTime": 1616442586.5631692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4071515133506373, "count": 1, "min": 0.4071515133506373, "max": 0.4071515133506373}}} #metrics {"StartTime": 1616442586.5632284, "EndTime": 1616442586.563246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6595348558927837, "count": 1, "min": 0.6595348558927837, "max": 0.6595348558927837}}} #metrics {"StartTime": 1616442586.5633142, "EndTime": 1616442586.563333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6171591507761102, "count": 1, "min": 0.6171591507761102, "max": 0.6171591507761102}}} #metrics {"StartTime": 1616442586.563395, "EndTime": 1616442586.5634115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7505728470651727, "count": 1, "min": 0.7505728470651727, "max": 0.7505728470651727}}} #metrics {"StartTime": 1616442586.563482, "EndTime": 1616442586.5635011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6798637791683799, "count": 1, "min": 0.6798637791683799, "max": 0.6798637791683799}}} #metrics {"StartTime": 1616442586.563559, "EndTime": 1616442586.563576, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41209291156969574, "count": 1, "min": 0.41209291156969574, "max": 0.41209291156969574}}} #metrics {"StartTime": 1616442586.5636468, "EndTime": 1616442586.563664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4026527806332237, "count": 1, "min": 0.4026527806332237, "max": 0.4026527806332237}}} #metrics {"StartTime": 1616442586.563731, "EndTime": 1616442586.5637476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4362775702225535, "count": 1, "min": 0.4362775702225535, "max": 0.4362775702225535}}} #metrics {"StartTime": 1616442586.5638053, "EndTime": 1616442586.5638235, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4095110441509046, "count": 1, "min": 0.4095110441509046, "max": 0.4095110441509046}}} #metrics {"StartTime": 1616442586.56388, "EndTime": 1616442586.5638983, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6354935495476973, "count": 1, "min": 0.6354935495476973, "max": 0.6354935495476973}}} #metrics {"StartTime": 1616442586.5639665, "EndTime": 1616442586.5639868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6658704657303659, "count": 1, "min": 0.6658704657303659, "max": 0.6658704657303659}}} #metrics {"StartTime": 1616442586.5640414, "EndTime": 1616442586.564058, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6180238021047492, "count": 1, "min": 0.6180238021047492, "max": 0.6180238021047492}}} #metrics {"StartTime": 1616442586.5641084, "EndTime": 1616442586.5641255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6413441708213404, "count": 1, "min": 0.6413441708213404, "max": 0.6413441708213404}}} #metrics {"StartTime": 1616442586.5641775, "EndTime": 1616442586.564195, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4228750931589227, "count": 1, "min": 0.4228750931589227, "max": 0.4228750931589227}}} #metrics {"StartTime": 1616442586.564244, "EndTime": 1616442586.5642622, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4101974085757607, "count": 1, "min": 0.4101974085757607, "max": 0.4101974085757607}}} #metrics {"StartTime": 1616442586.564318, "EndTime": 1616442586.5643392, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.42252811632658305, "count": 1, "min": 0.42252811632658305, "max": 0.42252811632658305}}} #metrics {"StartTime": 1616442586.5644073, "EndTime": 1616442586.564427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4303488480417352, "count": 1, "min": 0.4303488480417352, "max": 0.4303488480417352}}} #metrics {"StartTime": 1616442586.5644841, "EndTime": 1616442586.564502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6391361838892886, "count": 1, "min": 0.6391361838892886, "max": 0.6391361838892886}}} #metrics {"StartTime": 1616442586.564568, "EndTime": 1616442586.5645876, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7487357691714638, "count": 1, "min": 0.7487357691714638, "max": 0.7487357691714638}}} #metrics {"StartTime": 1616442586.5646374, "EndTime": 1616442586.5646613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6735735441509046, "count": 1, "min": 0.6735735441509046, "max": 0.6735735441509046}}} #metrics {"StartTime": 1616442586.5647104, "EndTime": 1616442586.564728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.635866988332648, "count": 1, "min": 0.635866988332648, "max": 0.635866988332648}}} #metrics {"StartTime": 1616442586.5647938, "EndTime": 1616442586.564813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6696334838867187, "count": 1, "min": 0.6696334838867187, "max": 0.6696334838867187}}} #metrics {"StartTime": 1616442586.564872, "EndTime": 1616442586.5648887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6118876808568051, "count": 1, "min": 0.6118876808568051, "max": 0.6118876808568051}}} #metrics {"StartTime": 1616442586.564956, "EndTime": 1616442586.5649736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6390460767244038, "count": 1, "min": 0.6390460767244038, "max": 0.6390460767244038}}} #metrics {"StartTime": 1616442586.565028, "EndTime": 1616442586.5650427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854664852744654, "count": 1, "min": 0.6854664852744654, "max": 0.6854664852744654}}} [03/22/2021 19:49:46 INFO 140389653051200] #quality_metric: host=algo-1, epoch=1, validation binary_classification_cross_entropy_objective <loss>=0.6869888305664062 [03/22/2021 19:49:46 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:46 INFO 140389653051200] Epoch 1: Loss improved. Updating best model [03/22/2021 19:49:46 INFO 140389653051200] Saving model for epoch: 1 [03/22/2021 19:49:46 INFO 140389653051200] Saved checkpoint to "/tmp/tmpfkvdmorx/mx-mod-0000.params" [03/22/2021 19:49:46 INFO 140389653051200] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs #metrics {"StartTime": 1616442586.114051, "EndTime": 1616442586.573421, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3024.0, "count": 1, "min": 3024, "max": 3024}, "Total Batches Seen": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:46 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1645.1553579850297 records/second [2021-03-22 19:49:46.629] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 8, "duration": 55, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442586.6291924, "EndTime": 1616442586.629327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6750090664656705, "count": 1, "min": 0.6750090664656705, "max": 0.6750090664656705}}} #metrics {"StartTime": 1616442586.6294732, "EndTime": 1616442586.6294966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.719368990136202, "count": 1, "min": 0.719368990136202, "max": 0.719368990136202}}} #metrics {"StartTime": 1616442586.6295917, "EndTime": 1616442586.6296153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7154814705016121, "count": 1, "min": 0.7154814705016121, "max": 0.7154814705016121}}} #metrics {"StartTime": 1616442586.629725, "EndTime": 1616442586.62978, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6358223163261616, "count": 1, "min": 0.6358223163261616, "max": 0.6358223163261616}}} #metrics {"StartTime": 1616442586.6298475, "EndTime": 1616442586.6298685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3761720606889674, "count": 1, "min": 0.3761720606889674, "max": 0.3761720606889674}}} #metrics {"StartTime": 1616442586.629963, "EndTime": 1616442586.6300306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3815119506190063, "count": 1, "min": 0.3815119506190063, "max": 0.3815119506190063}}} #metrics {"StartTime": 1616442586.6300976, "EndTime": 1616442586.6301465, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3879795377216642, "count": 1, "min": 0.3879795377216642, "max": 0.3879795377216642}}} #metrics {"StartTime": 1616442586.6302464, "EndTime": 1616442586.6302688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.37468222966269843, "count": 1, "min": 0.37468222966269843, "max": 0.37468222966269843}}} #metrics {"StartTime": 1616442586.6303709, "EndTime": 1616442586.6303928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6630908622943535, "count": 1, "min": 0.6630908622943535, "max": 0.6630908622943535}}} #metrics {"StartTime": 1616442586.630488, "EndTime": 1616442586.630511, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6218155149429564, "count": 1, "min": 0.6218155149429564, "max": 0.6218155149429564}}} #metrics {"StartTime": 1616442586.630602, "EndTime": 1616442586.6306224, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7404132822833994, "count": 1, "min": 0.7404132822833994, "max": 0.7404132822833994}}} #metrics {"StartTime": 1616442586.630709, "EndTime": 1616442586.6307278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6730467377516328, "count": 1, "min": 0.6730467377516328, "max": 0.6730467377516328}}} #metrics {"StartTime": 1616442586.6307817, "EndTime": 1616442586.630801, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.38195009584780093, "count": 1, "min": 0.38195009584780093, "max": 0.38195009584780093}}} #metrics {"StartTime": 1616442586.6308577, "EndTime": 1616442586.6308737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.371861008739976, "count": 1, "min": 0.371861008739976, "max": 0.371861008739976}}} #metrics {"StartTime": 1616442586.63093, "EndTime": 1616442586.6309478, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3926155857308201, "count": 1, "min": 0.3926155857308201, "max": 0.3926155857308201}}} #metrics {"StartTime": 1616442586.6310034, "EndTime": 1616442586.6310203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3767135054976852, "count": 1, "min": 0.3767135054976852, "max": 0.3767135054976852}}} #metrics {"StartTime": 1616442586.6310856, "EndTime": 1616442586.6311042, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6276341594716228, "count": 1, "min": 0.6276341594716228, "max": 0.6276341594716228}}} #metrics {"StartTime": 1616442586.6311564, "EndTime": 1616442586.6311746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6548712190496858, "count": 1, "min": 0.6548712190496858, "max": 0.6548712190496858}}} #metrics {"StartTime": 1616442586.6312294, "EndTime": 1616442586.6312463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6220152516844412, "count": 1, "min": 0.6220152516844412, "max": 0.6220152516844412}}} #metrics {"StartTime": 1616442586.6313024, "EndTime": 1616442586.63132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6587290284494874, "count": 1, "min": 0.6587290284494874, "max": 0.6587290284494874}}} #metrics {"StartTime": 1616442586.631374, "EndTime": 1616442586.6313913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.40469223103195273, "count": 1, "min": 0.40469223103195273, "max": 0.40469223103195273}}} #metrics {"StartTime": 1616442586.6314447, "EndTime": 1616442586.631464, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3934184886791088, "count": 1, "min": 0.3934184886791088, "max": 0.3934184886791088}}} #metrics {"StartTime": 1616442586.6315196, "EndTime": 1616442586.6315353, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.40620204380580355, "count": 1, "min": 0.40620204380580355, "max": 0.40620204380580355}}} #metrics {"StartTime": 1616442586.6315906, "EndTime": 1616442586.6316059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4034926803023727, "count": 1, "min": 0.4034926803023727, "max": 0.4034926803023727}}} #metrics {"StartTime": 1616442586.631662, "EndTime": 1616442586.6316786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6476212758866567, "count": 1, "min": 0.6476212758866567, "max": 0.6476212758866567}}} #metrics {"StartTime": 1616442586.631735, "EndTime": 1616442586.631751, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7559187954695767, "count": 1, "min": 0.7559187954695767, "max": 0.7559187954695767}}} #metrics {"StartTime": 1616442586.631804, "EndTime": 1616442586.6318219, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6813648365162037, "count": 1, "min": 0.6813648365162037, "max": 0.6813648365162037}}} #metrics {"StartTime": 1616442586.631876, "EndTime": 1616442586.6318946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6415326153790509, "count": 1, "min": 0.6415326153790509, "max": 0.6415326153790509}}} #metrics {"StartTime": 1616442586.6319509, "EndTime": 1616442586.631968, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6679314507378472, "count": 1, "min": 0.6679314507378472, "max": 0.6679314507378472}}} #metrics {"StartTime": 1616442586.6320214, "EndTime": 1616442586.632039, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6033270295965608, "count": 1, "min": 0.6033270295965608, "max": 0.6033270295965608}}} #metrics {"StartTime": 1616442586.632093, "EndTime": 1616442586.6321108, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6354536833586516, "count": 1, "min": 0.6354536833586516, "max": 0.6354536833586516}}} #metrics {"StartTime": 1616442586.6321692, "EndTime": 1616442586.6321867, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865108429439484, "count": 1, "min": 0.6865108429439484, "max": 0.6865108429439484}}} [03/22/2021 19:49:46 INFO 140389653051200] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.6750090664656705 [2021-03-22 19:49:46.816] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 8, "duration": 154, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442587.048423, "EndTime": 1616442587.0485, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6687858179995888, "count": 1, "min": 0.6687858179995888, "max": 0.6687858179995888}}} #metrics {"StartTime": 1616442587.0485928, "EndTime": 1616442587.048608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7105025442023026, "count": 1, "min": 0.7105025442023026, "max": 0.7105025442023026}}} #metrics {"StartTime": 1616442587.0486555, "EndTime": 1616442587.0486715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6955367238898026, "count": 1, "min": 0.6955367238898026, "max": 0.6955367238898026}}} #metrics {"StartTime": 1616442587.0487123, "EndTime": 1616442587.0487273, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6180217542146381, "count": 1, "min": 0.6180217542146381, "max": 0.6180217542146381}}} #metrics {"StartTime": 1616442587.04878, "EndTime": 1616442587.0487962, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.33296390332673725, "count": 1, "min": 0.33296390332673725, "max": 0.33296390332673725}}} #metrics {"StartTime": 1616442587.0488415, "EndTime": 1616442587.0488555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.32423260337428045, "count": 1, "min": 0.32423260337428045, "max": 0.32423260337428045}}} #metrics {"StartTime": 1616442587.0489054, "EndTime": 1616442587.0489223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.33556277626439146, "count": 1, "min": 0.33556277626439146, "max": 0.33556277626439146}}} #metrics {"StartTime": 1616442587.0489824, "EndTime": 1616442587.0489988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.32841449536775286, "count": 1, "min": 0.32841449536775286, "max": 0.32841449536775286}}} #metrics {"StartTime": 1616442587.049059, "EndTime": 1616442587.0490763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.643067129034745, "count": 1, "min": 0.643067129034745, "max": 0.643067129034745}}} #metrics {"StartTime": 1616442587.0491416, "EndTime": 1616442587.049161, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6022735595703125, "count": 1, "min": 0.6022735595703125, "max": 0.6022735595703125}}} #metrics {"StartTime": 1616442587.0492272, "EndTime": 1616442587.0492458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7301267925061677, "count": 1, "min": 0.7301267925061677, "max": 0.7301267925061677}}} #metrics {"StartTime": 1616442587.0493138, "EndTime": 1616442587.0493324, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6622110467208059, "count": 1, "min": 0.6622110467208059, "max": 0.6622110467208059}}} #metrics {"StartTime": 1616442587.049398, "EndTime": 1616442587.0494156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3274527499550267, "count": 1, "min": 0.3274527499550267, "max": 0.3274527499550267}}} #metrics {"StartTime": 1616442587.0494847, "EndTime": 1616442587.049502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3240308259662829, "count": 1, "min": 0.3240308259662829, "max": 0.3240308259662829}}} #metrics {"StartTime": 1616442587.0495672, "EndTime": 1616442587.0495856, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.34805884110300167, "count": 1, "min": 0.34805884110300167, "max": 0.34805884110300167}}} #metrics {"StartTime": 1616442587.0496407, "EndTime": 1616442587.0496583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.33039745531584086, "count": 1, "min": 0.33039745531584086, "max": 0.33039745531584086}}} #metrics {"StartTime": 1616442587.049724, "EndTime": 1616442587.049741, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6197484066611842, "count": 1, "min": 0.6197484066611842, "max": 0.6197484066611842}}} #metrics {"StartTime": 1616442587.0498075, "EndTime": 1616442587.0498261, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6488603290758634, "count": 1, "min": 0.6488603290758634, "max": 0.6488603290758634}}} #metrics {"StartTime": 1616442587.0498874, "EndTime": 1616442587.0499032, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6040475142629523, "count": 1, "min": 0.6040475142629523, "max": 0.6040475142629523}}} #metrics {"StartTime": 1616442587.0499876, "EndTime": 1616442587.050004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6271961412931744, "count": 1, "min": 0.6271961412931744, "max": 0.6271961412931744}}} #metrics {"StartTime": 1616442587.050066, "EndTime": 1616442587.0500822, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.37255104466488487, "count": 1, "min": 0.37255104466488487, "max": 0.37255104466488487}}} #metrics {"StartTime": 1616442587.0501392, "EndTime": 1616442587.0501535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.37081636127672696, "count": 1, "min": 0.37081636127672696, "max": 0.37081636127672696}}} #metrics {"StartTime": 1616442587.050213, "EndTime": 1616442587.05023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3820140637849507, "count": 1, "min": 0.3820140637849507, "max": 0.3820140637849507}}} #metrics {"StartTime": 1616442587.0502963, "EndTime": 1616442587.0503144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3836455897281044, "count": 1, "min": 0.3836455897281044, "max": 0.3836455897281044}}} #metrics {"StartTime": 1616442587.0503824, "EndTime": 1616442587.0503998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6458188107139186, "count": 1, "min": 0.6458188107139186, "max": 0.6458188107139186}}} #metrics {"StartTime": 1616442587.0504673, "EndTime": 1616442587.0504844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7384794536389803, "count": 1, "min": 0.7384794536389803, "max": 0.7384794536389803}}} #metrics {"StartTime": 1616442587.0505438, "EndTime": 1616442587.0505612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6769271850585937, "count": 1, "min": 0.6769271850585937, "max": 0.6769271850585937}}} #metrics {"StartTime": 1616442587.0506153, "EndTime": 1616442587.050633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6394941631116365, "count": 1, "min": 0.6394941631116365, "max": 0.6394941631116365}}} #metrics {"StartTime": 1616442587.0506976, "EndTime": 1616442587.0507147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6611180355674342, "count": 1, "min": 0.6611180355674342, "max": 0.6611180355674342}}} #metrics {"StartTime": 1616442587.0507698, "EndTime": 1616442587.0507877, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6673253109580592, "count": 1, "min": 0.6673253109580592, "max": 0.6673253109580592}}} #metrics {"StartTime": 1616442587.0508444, "EndTime": 1616442587.050861, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6967182360197368, "count": 1, "min": 0.6967182360197368, "max": 0.6967182360197368}}} #metrics {"StartTime": 1616442587.0509264, "EndTime": 1616442587.0509453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6938879715768914, "count": 1, "min": 0.6938879715768914, "max": 0.6938879715768914}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=2, validation binary_classification_cross_entropy_objective <loss>=0.6687858179995888 [03/22/2021 19:49:47 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:47 INFO 140389653051200] Epoch 2: Loss improved. Updating best model [03/22/2021 19:49:47 INFO 140389653051200] Saving model for epoch: 2 [03/22/2021 19:49:47 INFO 140389653051200] Saved checkpoint to "/tmp/tmpu2d7_a3z/mx-mod-0000.params" [03/22/2021 19:49:47 INFO 140389653051200] #progress_metric: host=algo-1, completed 20.0 % of epochs #metrics {"StartTime": 1616442586.5737648, "EndTime": 1616442587.0596032, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3780.0, "count": 1, "min": 3780, "max": 3780}, "Total Batches Seen": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:47 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1555.524836249897 records/second [2021-03-22 19:49:47.109] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 10, "duration": 49, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442587.1098118, "EndTime": 1616442587.1099403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6558158914878885, "count": 1, "min": 0.6558158914878885, "max": 0.6558158914878885}}} #metrics {"StartTime": 1616442587.110055, "EndTime": 1616442587.1100767, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6983723312458664, "count": 1, "min": 0.6983723312458664, "max": 0.6983723312458664}}} #metrics {"StartTime": 1616442587.1101341, "EndTime": 1616442587.1101496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6939847431485615, "count": 1, "min": 0.6939847431485615, "max": 0.6939847431485615}}} #metrics {"StartTime": 1616442587.1101987, "EndTime": 1616442587.1102147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.618511785275091, "count": 1, "min": 0.618511785275091, "max": 0.618511785275091}}} #metrics {"StartTime": 1616442587.1102629, "EndTime": 1616442587.1102777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3009420122419085, "count": 1, "min": 0.3009420122419085, "max": 0.3009420122419085}}} #metrics {"StartTime": 1616442587.1103244, "EndTime": 1616442587.110338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.30701444514844783, "count": 1, "min": 0.30701444514844783, "max": 0.30701444514844783}}} #metrics {"StartTime": 1616442587.1103814, "EndTime": 1616442587.1103964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3117785378107949, "count": 1, "min": 0.3117785378107949, "max": 0.3117785378107949}}} #metrics {"StartTime": 1616442587.110471, "EndTime": 1616442587.1104894, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3001753388258515, "count": 1, "min": 0.3001753388258515, "max": 0.3001753388258515}}} #metrics {"StartTime": 1616442587.1105554, "EndTime": 1616442587.1105723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6451801522068246, "count": 1, "min": 0.6451801522068246, "max": 0.6451801522068246}}} #metrics {"StartTime": 1616442587.110639, "EndTime": 1616442587.1106565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6052131450996197, "count": 1, "min": 0.6052131450996197, "max": 0.6052131450996197}}} #metrics {"StartTime": 1616442587.1107223, "EndTime": 1616442587.110739, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7190040709480406, "count": 1, "min": 0.7190040709480406, "max": 0.7190040709480406}}} #metrics {"StartTime": 1616442587.110808, "EndTime": 1616442587.1108255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6542506142268105, "count": 1, "min": 0.6542506142268105, "max": 0.6542506142268105}}} #metrics {"StartTime": 1616442587.1108913, "EndTime": 1616442587.1109092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.30859199402824283, "count": 1, "min": 0.30859199402824283, "max": 0.30859199402824283}}} #metrics {"StartTime": 1616442587.1109746, "EndTime": 1616442587.1109922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.298473802193132, "count": 1, "min": 0.298473802193132, "max": 0.298473802193132}}} #metrics {"StartTime": 1616442587.1110632, "EndTime": 1616442587.1110814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3156117434224124, "count": 1, "min": 0.3156117434224124, "max": 0.3156117434224124}}} #metrics {"StartTime": 1616442587.1111453, "EndTime": 1616442587.1111624, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3027711898561508, "count": 1, "min": 0.3027711898561508, "max": 0.3027711898561508}}} #metrics {"StartTime": 1616442587.111213, "EndTime": 1616442587.1112282, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6122852708927538, "count": 1, "min": 0.6122852708927538, "max": 0.6122852708927538}}} #metrics {"StartTime": 1616442587.1112857, "EndTime": 1616442587.1113033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.638092767624628, "count": 1, "min": 0.638092767624628, "max": 0.638092767624628}}} #metrics {"StartTime": 1616442587.1113563, "EndTime": 1616442587.1113708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6056793051421958, "count": 1, "min": 0.6056793051421958, "max": 0.6056793051421958}}} #metrics {"StartTime": 1616442587.1114523, "EndTime": 1616442587.1114695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6407056535993304, "count": 1, "min": 0.6407056535993304, "max": 0.6407056535993304}}} #metrics {"StartTime": 1616442587.1115353, "EndTime": 1616442587.1115546, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.35789356534443206, "count": 1, "min": 0.35789356534443206, "max": 0.35789356534443206}}} #metrics {"StartTime": 1616442587.1116436, "EndTime": 1616442587.111663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3556003873310392, "count": 1, "min": 0.3556003873310392, "max": 0.3556003873310392}}} #metrics {"StartTime": 1616442587.111729, "EndTime": 1616442587.111746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3683573404947917, "count": 1, "min": 0.3683573404947917, "max": 0.3683573404947917}}} #metrics {"StartTime": 1616442587.1118133, "EndTime": 1616442587.1118555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.35915725950210814, "count": 1, "min": 0.35915725950210814, "max": 0.35915725950210814}}} #metrics {"StartTime": 1616442587.111925, "EndTime": 1616442587.1119437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6535472567119296, "count": 1, "min": 0.6535472567119296, "max": 0.6535472567119296}}} #metrics {"StartTime": 1616442587.112007, "EndTime": 1616442587.112024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7444516136532738, "count": 1, "min": 0.7444516136532738, "max": 0.7444516136532738}}} #metrics {"StartTime": 1616442587.1120784, "EndTime": 1616442587.1120963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6837733838924025, "count": 1, "min": 0.6837733838924025, "max": 0.6837733838924025}}} #metrics {"StartTime": 1616442587.112158, "EndTime": 1616442587.1121733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6450745920655588, "count": 1, "min": 0.6450745920655588, "max": 0.6450745920655588}}} #metrics {"StartTime": 1616442587.1122258, "EndTime": 1616442587.112243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6560501825241816, "count": 1, "min": 0.6560501825241816, "max": 0.6560501825241816}}} #metrics {"StartTime": 1616442587.1123102, "EndTime": 1616442587.1123285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6691608731708829, "count": 1, "min": 0.6691608731708829, "max": 0.6691608731708829}}} #metrics {"StartTime": 1616442587.1124227, "EndTime": 1616442587.1124413, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6996283960090113, "count": 1, "min": 0.6996283960090113, "max": 0.6996283960090113}}} #metrics {"StartTime": 1616442587.1125095, "EndTime": 1616442587.1125271, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6993239468367642, "count": 1, "min": 0.6993239468367642, "max": 0.6993239468367642}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.6558158914878885 [2021-03-22 19:49:47.300] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 11, "duration": 156, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442587.5259593, "EndTime": 1616442587.5260375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6515942222193668, "count": 1, "min": 0.6515942222193668, "max": 0.6515942222193668}}} #metrics {"StartTime": 1616442587.5261376, "EndTime": 1616442587.5261571, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6919968454461348, "count": 1, "min": 0.6919968454461348, "max": 0.6919968454461348}}} #metrics {"StartTime": 1616442587.5262108, "EndTime": 1616442587.5262275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6774239791067023, "count": 1, "min": 0.6774239791067023, "max": 0.6774239791067023}}} #metrics {"StartTime": 1616442587.5262764, "EndTime": 1616442587.526292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6029605263157894, "count": 1, "min": 0.6029605263157894, "max": 0.6029605263157894}}} #metrics {"StartTime": 1616442587.5263388, "EndTime": 1616442587.5263524, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3064426622892681, "count": 1, "min": 0.3064426622892681, "max": 0.3064426622892681}}} #metrics {"StartTime": 1616442587.5263972, "EndTime": 1616442587.526413, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3015961295679996, "count": 1, "min": 0.3015961295679996, "max": 0.3015961295679996}}} #metrics {"StartTime": 1616442587.5264642, "EndTime": 1616442587.5264814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.30880924024079975, "count": 1, "min": 0.30880924024079975, "max": 0.30880924024079975}}} #metrics {"StartTime": 1616442587.5265334, "EndTime": 1616442587.52655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3044189854672081, "count": 1, "min": 0.3044189854672081, "max": 0.3044189854672081}}} #metrics {"StartTime": 1616442587.5266032, "EndTime": 1616442587.5266197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6275601838764392, "count": 1, "min": 0.6275601838764392, "max": 0.6275601838764392}}} #metrics {"StartTime": 1616442587.5266736, "EndTime": 1616442587.5266914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5881333602102179, "count": 1, "min": 0.5881333602102179, "max": 0.5881333602102179}}} #metrics {"StartTime": 1616442587.5267444, "EndTime": 1616442587.5267615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7107982434724507, "count": 1, "min": 0.7107982434724507, "max": 0.7107982434724507}}} #metrics {"StartTime": 1616442587.5268145, "EndTime": 1616442587.526831, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6455710561651933, "count": 1, "min": 0.6455710561651933, "max": 0.6455710561651933}}} #metrics {"StartTime": 1616442587.5268826, "EndTime": 1616442587.5269003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29980980722527756, "count": 1, "min": 0.29980980722527756, "max": 0.29980980722527756}}} #metrics {"StartTime": 1616442587.5269544, "EndTime": 1616442587.5269701, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29873143246299344, "count": 1, "min": 0.29873143246299344, "max": 0.29873143246299344}}} #metrics {"StartTime": 1616442587.5270324, "EndTime": 1616442587.5270486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.31679623252467104, "count": 1, "min": 0.31679623252467104, "max": 0.31679623252467104}}} #metrics {"StartTime": 1616442587.527102, "EndTime": 1616442587.5271187, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.3052890978361431, "count": 1, "min": 0.3052890978361431, "max": 0.3052890978361431}}} #metrics {"StartTime": 1616442587.5271723, "EndTime": 1616442587.527189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6051557842053865, "count": 1, "min": 0.6051557842053865, "max": 0.6051557842053865}}} #metrics {"StartTime": 1616442587.5272439, "EndTime": 1616442587.5272608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.633272351716694, "count": 1, "min": 0.633272351716694, "max": 0.633272351716694}}} #metrics {"StartTime": 1616442587.5273151, "EndTime": 1616442587.5273325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5909208598889802, "count": 1, "min": 0.5909208598889802, "max": 0.5909208598889802}}} #metrics {"StartTime": 1616442587.5273874, "EndTime": 1616442587.5274038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6139284635844984, "count": 1, "min": 0.6139284635844984, "max": 0.6139284635844984}}} #metrics {"StartTime": 1616442587.5274699, "EndTime": 1616442587.5274873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4130964981882196, "count": 1, "min": 0.4130964981882196, "max": 0.4130964981882196}}} #metrics {"StartTime": 1616442587.5275407, "EndTime": 1616442587.527557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41899566650390624, "count": 1, "min": 0.41899566650390624, "max": 0.41899566650390624}}} #metrics {"StartTime": 1616442587.5276127, "EndTime": 1616442587.5276296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44315868176912004, "count": 1, "min": 0.44315868176912004, "max": 0.44315868176912004}}} #metrics {"StartTime": 1616442587.5276983, "EndTime": 1616442587.5277157, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4225319310238487, "count": 1, "min": 0.4225319310238487, "max": 0.4225319310238487}}} #metrics {"StartTime": 1616442587.527783, "EndTime": 1616442587.5278003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6524599978798314, "count": 1, "min": 0.6524599978798314, "max": 0.6524599978798314}}} #metrics {"StartTime": 1616442587.5278692, "EndTime": 1616442587.5278869, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7297077379728618, "count": 1, "min": 0.7297077379728618, "max": 0.7297077379728618}}} #metrics {"StartTime": 1616442587.5279381, "EndTime": 1616442587.5279531, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6802970484683388, "count": 1, "min": 0.6802970484683388, "max": 0.6802970484683388}}} #metrics {"StartTime": 1616442587.528003, "EndTime": 1616442587.5280187, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6436890451531662, "count": 1, "min": 0.6436890451531662, "max": 0.6436890451531662}}} #metrics {"StartTime": 1616442587.528065, "EndTime": 1616442587.5280788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7151805676912006, "count": 1, "min": 0.7151805676912006, "max": 0.7151805676912006}}} #metrics {"StartTime": 1616442587.5281274, "EndTime": 1616442587.5282114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7813793784693668, "count": 1, "min": 0.7813793784693668, "max": 0.7813793784693668}}} #metrics {"StartTime": 1616442587.5282702, "EndTime": 1616442587.5282886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7800953112150494, "count": 1, "min": 0.7800953112150494, "max": 0.7800953112150494}}} #metrics {"StartTime": 1616442587.5283425, "EndTime": 1616442587.5283597, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.735483832108347, "count": 1, "min": 0.735483832108347, "max": 0.735483832108347}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=3, validation binary_classification_cross_entropy_objective <loss>=0.6515942222193668 [03/22/2021 19:49:47 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=sampled_accuracy, value=0.9052631578948366 [03/22/2021 19:49:47 INFO 140389653051200] Epoch 3: Loss improved. Updating best model [03/22/2021 19:49:47 INFO 140389653051200] Saving model for epoch: 3 [03/22/2021 19:49:47 INFO 140389653051200] Saved checkpoint to "/tmp/tmp7a7i3g3y/mx-mod-0000.params" [03/22/2021 19:49:47 INFO 140389653051200] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs #metrics {"StartTime": 1616442587.0599556, "EndTime": 1616442587.5382085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4536.0, "count": 1, "min": 4536, "max": 4536}, "Total Batches Seen": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:47 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1580.249471488275 records/second [2021-03-22 19:49:47.584] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 12, "duration": 46, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442587.5848415, "EndTime": 1616442587.5849397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6376356498274223, "count": 1, "min": 0.6376356498274223, "max": 0.6376356498274223}}} #metrics {"StartTime": 1616442587.585047, "EndTime": 1616442587.585066, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6784462096199156, "count": 1, "min": 0.6784462096199156, "max": 0.6784462096199156}}} #metrics {"StartTime": 1616442587.5851188, "EndTime": 1616442587.5851333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6735642851975859, "count": 1, "min": 0.6735642851975859, "max": 0.6735642851975859}}} #metrics {"StartTime": 1616442587.585176, "EndTime": 1616442587.5851877, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6021999782986112, "count": 1, "min": 0.6021999782986112, "max": 0.6021999782986112}}} #metrics {"StartTime": 1616442587.5852277, "EndTime": 1616442587.5852394, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2781663117585359, "count": 1, "min": 0.2781663117585359, "max": 0.2781663117585359}}} #metrics {"StartTime": 1616442587.5852816, "EndTime": 1616442587.585296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.28396144241252275, "count": 1, "min": 0.28396144241252275, "max": 0.28396144241252275}}} #metrics {"StartTime": 1616442587.58535, "EndTime": 1616442587.5853615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.28782609404710235, "count": 1, "min": 0.28782609404710235, "max": 0.28782609404710235}}} #metrics {"StartTime": 1616442587.5854037, "EndTime": 1616442587.5854173, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2780171147099248, "count": 1, "min": 0.2780171147099248, "max": 0.2780171147099248}}} #metrics {"StartTime": 1616442587.585459, "EndTime": 1616442587.5854702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6282676010535507, "count": 1, "min": 0.6282676010535507, "max": 0.6282676010535507}}} #metrics {"StartTime": 1616442587.5855095, "EndTime": 1616442587.5855234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5895970662434896, "count": 1, "min": 0.5895970662434896, "max": 0.5895970662434896}}} #metrics {"StartTime": 1616442587.585565, "EndTime": 1616442587.5855765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6986672537667411, "count": 1, "min": 0.6986672537667411, "max": 0.6986672537667411}}} #metrics {"StartTime": 1616442587.585614, "EndTime": 1616442587.5856247, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.636495519567419, "count": 1, "min": 0.636495519567419, "max": 0.636495519567419}}} #metrics {"StartTime": 1616442587.585662, "EndTime": 1616442587.5856726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2864331644048136, "count": 1, "min": 0.2864331644048136, "max": 0.2864331644048136}}} #metrics {"StartTime": 1616442587.585713, "EndTime": 1616442587.5857263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.27524227566189235, "count": 1, "min": 0.27524227566189235, "max": 0.27524227566189235}}} #metrics {"StartTime": 1616442587.5857677, "EndTime": 1616442587.5857785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2917501459676753, "count": 1, "min": 0.2917501459676753, "max": 0.2917501459676753}}} #metrics {"StartTime": 1616442587.585817, "EndTime": 1616442587.5858305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2795974691078146, "count": 1, "min": 0.2795974691078146, "max": 0.2795974691078146}}} #metrics {"StartTime": 1616442587.5858734, "EndTime": 1616442587.5858848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5977228961924397, "count": 1, "min": 0.5977228961924397, "max": 0.5977228961924397}}} #metrics {"StartTime": 1616442587.5859566, "EndTime": 1616442587.5859745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6222667391338046, "count": 1, "min": 0.6222667391338046, "max": 0.6222667391338046}}} #metrics {"StartTime": 1616442587.586027, "EndTime": 1616442587.5861065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5904129270523314, "count": 1, "min": 0.5904129270523314, "max": 0.5904129270523314}}} #metrics {"StartTime": 1616442587.5861642, "EndTime": 1616442587.5861788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6240059988839286, "count": 1, "min": 0.6240059988839286, "max": 0.6240059988839286}}} #metrics {"StartTime": 1616442587.5862274, "EndTime": 1616442587.5862422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.39918344487588875, "count": 1, "min": 0.39918344487588875, "max": 0.39918344487588875}}} #metrics {"StartTime": 1616442587.5862975, "EndTime": 1616442587.5863152, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4080348746486442, "count": 1, "min": 0.4080348746486442, "max": 0.4080348746486442}}} #metrics {"StartTime": 1616442587.586367, "EndTime": 1616442587.5863843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.42909640357607887, "count": 1, "min": 0.42909640357607887, "max": 0.42909640357607887}}} #metrics {"StartTime": 1616442587.5864377, "EndTime": 1616442587.5864542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.40134454151940724, "count": 1, "min": 0.40134454151940724, "max": 0.40134454151940724}}} #metrics {"StartTime": 1616442587.5865068, "EndTime": 1616442587.5865245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6592236877118469, "count": 1, "min": 0.6592236877118469, "max": 0.6592236877118469}}} #metrics {"StartTime": 1616442587.586575, "EndTime": 1616442587.5865903, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7346209167803406, "count": 1, "min": 0.7346209167803406, "max": 0.7346209167803406}}} #metrics {"StartTime": 1616442587.5866404, "EndTime": 1616442587.586655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860785105871776, "count": 1, "min": 0.6860785105871776, "max": 0.6860785105871776}}} #metrics {"StartTime": 1616442587.5867002, "EndTime": 1616442587.5867155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6490122477213541, "count": 1, "min": 0.6490122477213541, "max": 0.6490122477213541}}} #metrics {"StartTime": 1616442587.5867646, "EndTime": 1616442587.5867798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7111084145843667, "count": 1, "min": 0.7111084145843667, "max": 0.7111084145843667}}} #metrics {"StartTime": 1616442587.5868278, "EndTime": 1616442587.5868423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7893504793681796, "count": 1, "min": 0.7893504793681796, "max": 0.7893504793681796}}} #metrics {"StartTime": 1616442587.5868936, "EndTime": 1616442587.5869093, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7919637690145502, "count": 1, "min": 0.7919637690145502, "max": 0.7919637690145502}}} #metrics {"StartTime": 1616442587.5869567, "EndTime": 1616442587.5869699, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7478511749751984, "count": 1, "min": 0.7478511749751984, "max": 0.7478511749751984}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.6376356498274223 [2021-03-22 19:49:47.748] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 14, "duration": 126, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442587.8997645, "EndTime": 1616442587.8998358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6353025737561677, "count": 1, "min": 0.6353025737561677, "max": 0.6353025737561677}}} #metrics {"StartTime": 1616442587.8999283, "EndTime": 1616442587.8999426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.674372703150699, "count": 1, "min": 0.674372703150699, "max": 0.674372703150699}}} #metrics {"StartTime": 1616442587.899981, "EndTime": 1616442587.899997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.660112160130551, "count": 1, "min": 0.660112160130551, "max": 0.660112160130551}}} #metrics {"StartTime": 1616442587.9000468, "EndTime": 1616442587.9000616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5888455842670641, "count": 1, "min": 0.5888455842670641, "max": 0.5888455842670641}}} #metrics {"StartTime": 1616442587.9001217, "EndTime": 1616442587.9001367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29806388051886307, "count": 1, "min": 0.29806388051886307, "max": 0.29806388051886307}}} #metrics {"StartTime": 1616442587.900193, "EndTime": 1616442587.90021, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2957039080168072, "count": 1, "min": 0.2957039080168072, "max": 0.2957039080168072}}} #metrics {"StartTime": 1616442587.9002767, "EndTime": 1616442587.900294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29810592249820106, "count": 1, "min": 0.29810592249820106, "max": 0.29810592249820106}}} #metrics {"StartTime": 1616442587.900351, "EndTime": 1616442587.9003673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29721675672029196, "count": 1, "min": 0.29721675672029196, "max": 0.29721675672029196}}} #metrics {"StartTime": 1616442587.9004173, "EndTime": 1616442587.9004278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.612904157136616, "count": 1, "min": 0.612904157136616, "max": 0.612904157136616}}} #metrics {"StartTime": 1616442587.9004655, "EndTime": 1616442587.9004745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.57466502942537, "count": 1, "min": 0.57466502942537, "max": 0.57466502942537}}} #metrics {"StartTime": 1616442587.900513, "EndTime": 1616442587.9005282, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6925188566509046, "count": 1, "min": 0.6925188566509046, "max": 0.6925188566509046}}} #metrics {"StartTime": 1616442587.9005783, "EndTime": 1616442587.9005926, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6297981663754112, "count": 1, "min": 0.6297981663754112, "max": 0.6297981663754112}}} #metrics {"StartTime": 1616442587.900645, "EndTime": 1616442587.9006608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.28952452007092927, "count": 1, "min": 0.28952452007092927, "max": 0.28952452007092927}}} #metrics {"StartTime": 1616442587.900712, "EndTime": 1616442587.9007275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29200381228798317, "count": 1, "min": 0.29200381228798317, "max": 0.29200381228798317}}} #metrics {"StartTime": 1616442587.9007783, "EndTime": 1616442587.9007945, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.30274075959858143, "count": 1, "min": 0.30274075959858143, "max": 0.30274075959858143}}} #metrics {"StartTime": 1616442587.9008465, "EndTime": 1616442587.9008625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.29675995676141037, "count": 1, "min": 0.29675995676141037, "max": 0.29675995676141037}}} #metrics {"StartTime": 1616442587.9009147, "EndTime": 1616442587.9009311, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5916107980828537, "count": 1, "min": 0.5916107980828537, "max": 0.5916107980828537}}} #metrics {"StartTime": 1616442587.900982, "EndTime": 1616442587.9009993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6188593011153372, "count": 1, "min": 0.6188593011153372, "max": 0.6188593011153372}}} #metrics {"StartTime": 1616442587.901051, "EndTime": 1616442587.9010684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.578596335963199, "count": 1, "min": 0.578596335963199, "max": 0.578596335963199}}} #metrics {"StartTime": 1616442587.9011304, "EndTime": 1616442587.9011476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6014701441714638, "count": 1, "min": 0.6014701441714638, "max": 0.6014701441714638}}} #metrics {"StartTime": 1616442587.9012039, "EndTime": 1616442587.9012213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45060055381373354, "count": 1, "min": 0.45060055381373354, "max": 0.45060055381373354}}} #metrics {"StartTime": 1616442587.9012754, "EndTime": 1616442587.9012926, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4580052425986842, "count": 1, "min": 0.4580052425986842, "max": 0.4580052425986842}}} #metrics {"StartTime": 1616442587.9013324, "EndTime": 1616442587.9013479, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.47995786164936266, "count": 1, "min": 0.47995786164936266, "max": 0.47995786164936266}}} #metrics {"StartTime": 1616442587.9014072, "EndTime": 1616442587.9014235, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45307119269120066, "count": 1, "min": 0.45307119269120066, "max": 0.45307119269120066}}} #metrics {"StartTime": 1616442587.9014773, "EndTime": 1616442587.901494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6586865876850329, "count": 1, "min": 0.6586865876850329, "max": 0.6586865876850329}}} #metrics {"StartTime": 1616442587.9015477, "EndTime": 1616442587.9015663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7218680933902138, "count": 1, "min": 0.7218680933902138, "max": 0.7218680933902138}}} #metrics {"StartTime": 1616442587.9016333, "EndTime": 1616442587.9016516, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6833050376490543, "count": 1, "min": 0.6833050376490543, "max": 0.6833050376490543}}} #metrics {"StartTime": 1616442587.901719, "EndTime": 1616442587.9017363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6483446623149671, "count": 1, "min": 0.6483446623149671, "max": 0.6483446623149671}}} #metrics {"StartTime": 1616442587.9017901, "EndTime": 1616442587.9018068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7294035259046052, "count": 1, "min": 0.7294035259046052, "max": 0.7294035259046052}}} #metrics {"StartTime": 1616442587.90186, "EndTime": 1616442587.9018772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.8122476678145559, "count": 1, "min": 0.8122476678145559, "max": 0.8122476678145559}}} #metrics {"StartTime": 1616442587.90195, "EndTime": 1616442587.901962, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7817500064247533, "count": 1, "min": 0.7817500064247533, "max": 0.7817500064247533}}} #metrics {"StartTime": 1616442587.902002, "EndTime": 1616442587.902017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7272313168174342, "count": 1, "min": 0.7272313168174342, "max": 0.7272313168174342}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=4, validation binary_classification_cross_entropy_objective <loss>=0.6353025737561677 [03/22/2021 19:49:47 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=sampled_accuracy, value=0.9052631578948366 [03/22/2021 19:49:47 INFO 140389653051200] Epoch 4: Loss improved. Updating best model [03/22/2021 19:49:47 INFO 140389653051200] Saving model for epoch: 4 [03/22/2021 19:49:47 INFO 140389653051200] Saved checkpoint to "/tmp/tmpxo44rtcp/mx-mod-0000.params" [03/22/2021 19:49:47 INFO 140389653051200] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs #metrics {"StartTime": 1616442587.53857, "EndTime": 1616442587.9092128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5292.0, "count": 1, "min": 5292, "max": 5292}, "Total Batches Seen": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:47 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2038.8728687085227 records/second [2021-03-22 19:49:47.949] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 14, "duration": 40, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442587.9498825, "EndTime": 1616442587.9500086, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6203115957754629, "count": 1, "min": 0.6203115957754629, "max": 0.6203115957754629}}} #metrics {"StartTime": 1616442587.9501066, "EndTime": 1616442587.9501283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6594318208240327, "count": 1, "min": 0.6594318208240327, "max": 0.6594318208240327}}} #metrics {"StartTime": 1616442587.9501905, "EndTime": 1616442587.9502096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.654070495928406, "count": 1, "min": 0.654070495928406, "max": 0.654070495928406}}} #metrics {"StartTime": 1616442587.9502585, "EndTime": 1616442587.9502747, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5867111367523354, "count": 1, "min": 0.5867111367523354, "max": 0.5867111367523354}}} #metrics {"StartTime": 1616442587.950328, "EndTime": 1616442587.9503453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2707146134956804, "count": 1, "min": 0.2707146134956804, "max": 0.2707146134956804}}} #metrics {"StartTime": 1616442587.950399, "EndTime": 1616442587.950416, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2755059338120556, "count": 1, "min": 0.2755059338120556, "max": 0.2755059338120556}}} #metrics {"StartTime": 1616442587.9504695, "EndTime": 1616442587.9504952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2778537084185888, "count": 1, "min": 0.2778537084185888, "max": 0.2778537084185888}}} #metrics {"StartTime": 1616442587.950546, "EndTime": 1616442587.9505608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2713129760096313, "count": 1, "min": 0.2713129760096313, "max": 0.2713129760096313}}} #metrics {"StartTime": 1616442587.9506154, "EndTime": 1616442587.9506328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6121759969721395, "count": 1, "min": 0.6121759969721395, "max": 0.6121759969721395}}} #metrics {"StartTime": 1616442587.9506826, "EndTime": 1616442587.9506998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5747802976578001, "count": 1, "min": 0.5747802976578001, "max": 0.5747802976578001}}} #metrics {"StartTime": 1616442587.9507515, "EndTime": 1616442587.9507678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6792515345982143, "count": 1, "min": 0.6792515345982143, "max": 0.6792515345982143}}} #metrics {"StartTime": 1616442587.9508202, "EndTime": 1616442587.9508364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6196151006789434, "count": 1, "min": 0.6196151006789434, "max": 0.6196151006789434}}} #metrics {"StartTime": 1616442587.9508865, "EndTime": 1616442587.9509027, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2767926574384094, "count": 1, "min": 0.2767926574384094, "max": 0.2767926574384094}}} #metrics {"StartTime": 1616442587.9509525, "EndTime": 1616442587.9509685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2684122721354167, "count": 1, "min": 0.2684122721354167, "max": 0.2684122721354167}}} #metrics {"StartTime": 1616442587.951031, "EndTime": 1616442587.9510536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.280963453666243, "count": 1, "min": 0.280963453666243, "max": 0.280963453666243}}} #metrics {"StartTime": 1616442587.951099, "EndTime": 1616442587.951115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.271758548797123, "count": 1, "min": 0.271758548797123, "max": 0.271758548797123}}} #metrics {"StartTime": 1616442587.9511747, "EndTime": 1616442587.951192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5838092218631159, "count": 1, "min": 0.5838092218631159, "max": 0.5838092218631159}}} #metrics {"StartTime": 1616442587.9512427, "EndTime": 1616442587.9512591, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6072751807157325, "count": 1, "min": 0.6072751807157325, "max": 0.6072751807157325}}} #metrics {"StartTime": 1616442587.9513123, "EndTime": 1616442587.9513288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5760528725921792, "count": 1, "min": 0.5760528725921792, "max": 0.5760528725921792}}} #metrics {"StartTime": 1616442587.951375, "EndTime": 1616442587.9513907, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6084093366350446, "count": 1, "min": 0.6084093366350446, "max": 0.6084093366350446}}} #metrics {"StartTime": 1616442587.9514508, "EndTime": 1616442587.9514682, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.43371327718098956, "count": 1, "min": 0.43371327718098956, "max": 0.43371327718098956}}} #metrics {"StartTime": 1616442587.951518, "EndTime": 1616442587.9515333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490271674262153, "count": 1, "min": 0.4490271674262153, "max": 0.4490271674262153}}} #metrics {"StartTime": 1616442587.9515913, "EndTime": 1616442587.9516082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.46240722817718666, "count": 1, "min": 0.46240722817718666, "max": 0.46240722817718666}}} #metrics {"StartTime": 1616442587.95166, "EndTime": 1616442587.9516761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4353024518048322, "count": 1, "min": 0.4353024518048322, "max": 0.4353024518048322}}} #metrics {"StartTime": 1616442587.9517379, "EndTime": 1616442587.9517546, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6643642849392362, "count": 1, "min": 0.6643642849392362, "max": 0.6643642849392362}}} #metrics {"StartTime": 1616442587.9518044, "EndTime": 1616442587.9518209, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7258982179026124, "count": 1, "min": 0.7258982179026124, "max": 0.7258982179026124}}} #metrics {"StartTime": 1616442587.951872, "EndTime": 1616442587.9518888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6878947908916171, "count": 1, "min": 0.6878947908916171, "max": 0.6878947908916171}}} #metrics {"StartTime": 1616442587.9519398, "EndTime": 1616442587.9519565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6532091413225446, "count": 1, "min": 0.6532091413225446, "max": 0.6532091413225446}}} #metrics {"StartTime": 1616442587.9520128, "EndTime": 1616442587.9520302, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7289138067336309, "count": 1, "min": 0.7289138067336309, "max": 0.7289138067336309}}} #metrics {"StartTime": 1616442587.9520812, "EndTime": 1616442587.952098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.8206179987185847, "count": 1, "min": 0.8206179987185847, "max": 0.8206179987185847}}} #metrics {"StartTime": 1616442587.9521499, "EndTime": 1616442587.9521675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7932478485914766, "count": 1, "min": 0.7932478485914766, "max": 0.7932478485914766}}} #metrics {"StartTime": 1616442587.9522252, "EndTime": 1616442587.9522426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7369649574239417, "count": 1, "min": 0.7369649574239417, "max": 0.7369649574239417}}} [03/22/2021 19:49:47 INFO 140389653051200] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.6203115957754629 [2021-03-22 19:49:48.108] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 17, "duration": 132, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442588.2455215, "EndTime": 1616442588.245602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6199278982062089, "count": 1, "min": 0.6199278982062089, "max": 0.6199278982062089}}} #metrics {"StartTime": 1616442588.2456977, "EndTime": 1616442588.245718, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6575902838456004, "count": 1, "min": 0.6575902838456004, "max": 0.6575902838456004}}} #metrics {"StartTime": 1616442588.2457743, "EndTime": 1616442588.2457926, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6436208624588816, "count": 1, "min": 0.6436208624588816, "max": 0.6436208624588816}}} #metrics {"StartTime": 1616442588.2458537, "EndTime": 1616442588.245992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5756312721653989, "count": 1, "min": 0.5756312721653989, "max": 0.5756312721653989}}} #metrics {"StartTime": 1616442588.24612, "EndTime": 1616442588.246137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.28636219626978826, "count": 1, "min": 0.28636219626978826, "max": 0.28636219626978826}}} #metrics {"StartTime": 1616442588.246196, "EndTime": 1616442588.2462137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2855367560135691, "count": 1, "min": 0.2855367560135691, "max": 0.2855367560135691}}} #metrics {"StartTime": 1616442588.246272, "EndTime": 1616442588.2462897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.28372704355340256, "count": 1, "min": 0.28372704355340256, "max": 0.28372704355340256}}} #metrics {"StartTime": 1616442588.2463448, "EndTime": 1616442588.2463586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.28509055689761514, "count": 1, "min": 0.28509055689761514, "max": 0.28509055689761514}}} #metrics {"StartTime": 1616442588.246419, "EndTime": 1616442588.246436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5991104527523643, "count": 1, "min": 0.5991104527523643, "max": 0.5991104527523643}}} #metrics {"StartTime": 1616442588.246492, "EndTime": 1616442588.2465081, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5619496797260485, "count": 1, "min": 0.5619496797260485, "max": 0.5619496797260485}}} #metrics {"StartTime": 1616442588.2465687, "EndTime": 1616442588.2465854, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6752385189658717, "count": 1, "min": 0.6752385189658717, "max": 0.6752385189658717}}} #metrics {"StartTime": 1616442588.2466388, "EndTime": 1616442588.2466547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6148419831928454, "count": 1, "min": 0.6148419831928454, "max": 0.6148419831928454}}} #metrics {"StartTime": 1616442588.246705, "EndTime": 1616442588.2467217, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2771605240671258, "count": 1, "min": 0.2771605240671258, "max": 0.2771605240671258}}} #metrics {"StartTime": 1616442588.246786, "EndTime": 1616442588.246805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.28108986302425987, "count": 1, "min": 0.28108986302425987, "max": 0.28108986302425987}}} #metrics {"StartTime": 1616442588.2468703, "EndTime": 1616442588.2468886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.287579325625771, "count": 1, "min": 0.287579325625771, "max": 0.287579325625771}}} #metrics {"StartTime": 1616442588.2469566, "EndTime": 1616442588.246974, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2834586695620888, "count": 1, "min": 0.2834586695620888, "max": 0.2834586695620888}}} #metrics {"StartTime": 1616442588.2470398, "EndTime": 1616442588.2470567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5790667885228207, "count": 1, "min": 0.5790667885228207, "max": 0.5790667885228207}}} #metrics {"StartTime": 1616442588.2471244, "EndTime": 1616442588.247143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6054168701171875, "count": 1, "min": 0.6054168701171875, "max": 0.6054168701171875}}} #metrics {"StartTime": 1616442588.2472117, "EndTime": 1616442588.24723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.567137989244963, "count": 1, "min": 0.567137989244963, "max": 0.567137989244963}}} #metrics {"StartTime": 1616442588.2472892, "EndTime": 1616442588.2473059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5898906506990131, "count": 1, "min": 0.5898906506990131, "max": 0.5898906506990131}}} #metrics {"StartTime": 1616442588.2473679, "EndTime": 1616442588.2473838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4464524118523849, "count": 1, "min": 0.4464524118523849, "max": 0.4464524118523849}}} #metrics {"StartTime": 1616442588.2474444, "EndTime": 1616442588.2474627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45193220439710113, "count": 1, "min": 0.45193220439710113, "max": 0.45193220439710113}}} #metrics {"StartTime": 1616442588.247532, "EndTime": 1616442588.247551, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.46256641588712993, "count": 1, "min": 0.46256641588712993, "max": 0.46256641588712993}}} #metrics {"StartTime": 1616442588.2476187, "EndTime": 1616442588.2476366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4421582673725329, "count": 1, "min": 0.4421582673725329, "max": 0.4421582673725329}}} #metrics {"StartTime": 1616442588.2477038, "EndTime": 1616442588.2477214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6643484818307976, "count": 1, "min": 0.6643484818307976, "max": 0.6643484818307976}}} #metrics {"StartTime": 1616442588.2477846, "EndTime": 1616442588.2478018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7145615427117599, "count": 1, "min": 0.7145615427117599, "max": 0.7145615427117599}}} #metrics {"StartTime": 1616442588.2478676, "EndTime": 1616442588.2478867, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6860809326171875, "count": 1, "min": 0.6860809326171875, "max": 0.6860809326171875}}} #metrics {"StartTime": 1616442588.2479446, "EndTime": 1616442588.2479634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6533945987099096, "count": 1, "min": 0.6533945987099096, "max": 0.6533945987099096}}} #metrics {"StartTime": 1616442588.248032, "EndTime": 1616442588.2480507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7203421341745477, "count": 1, "min": 0.7203421341745477, "max": 0.7203421341745477}}} #metrics {"StartTime": 1616442588.2481167, "EndTime": 1616442588.2481346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.774406593724301, "count": 1, "min": 0.774406593724301, "max": 0.774406593724301}}} #metrics {"StartTime": 1616442588.2481976, "EndTime": 1616442588.2482147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7348943609940378, "count": 1, "min": 0.7348943609940378, "max": 0.7348943609940378}}} #metrics {"StartTime": 1616442588.2482796, "EndTime": 1616442588.2482977, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7000629625822369, "count": 1, "min": 0.7000629625822369, "max": 0.7000629625822369}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=5, validation binary_classification_cross_entropy_objective <loss>=0.6199278982062089 [03/22/2021 19:49:48 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:48 INFO 140389653051200] Epoch 5: Loss improved. Updating best model [03/22/2021 19:49:48 INFO 140389653051200] Saving model for epoch: 5 [03/22/2021 19:49:48 INFO 140389653051200] Saved checkpoint to "/tmp/tmppvlt8i6s/mx-mod-0000.params" [03/22/2021 19:49:48 INFO 140389653051200] #progress_metric: host=algo-1, completed 40.0 % of epochs #metrics {"StartTime": 1616442587.9095705, "EndTime": 1616442588.2558198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6048.0, "count": 1, "min": 6048, "max": 6048}, "Total Batches Seen": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:48 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2182.4418866675246 records/second [2021-03-22 19:49:48.292] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 16, "duration": 36, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442588.2929807, "EndTime": 1616442588.293081, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6039168746383102, "count": 1, "min": 0.6039168746383102, "max": 0.6039168746383102}}} #metrics {"StartTime": 1616442588.2931838, "EndTime": 1616442588.293206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6414040055855241, "count": 1, "min": 0.6414040055855241, "max": 0.6414040055855241}}} #metrics {"StartTime": 1616442588.2932725, "EndTime": 1616442588.2932932, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6355528654875578, "count": 1, "min": 0.6355528654875578, "max": 0.6355528654875578}}} #metrics {"StartTime": 1616442588.2933462, "EndTime": 1616442588.2933648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5720998774129877, "count": 1, "min": 0.5720998774129877, "max": 0.5720998774129877}}} #metrics {"StartTime": 1616442588.2934303, "EndTime": 1616442588.2934496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2588150589554398, "count": 1, "min": 0.2588150589554398, "max": 0.2588150589554398}}} #metrics {"StartTime": 1616442588.2935138, "EndTime": 1616442588.2935374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26239122663225445, "count": 1, "min": 0.26239122663225445, "max": 0.26239122663225445}}} #metrics {"StartTime": 1616442588.2935948, "EndTime": 1616442588.2936132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2637138568535053, "count": 1, "min": 0.2637138568535053, "max": 0.2637138568535053}}} #metrics {"StartTime": 1616442588.2936726, "EndTime": 1616442588.29369, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.25931551090623967, "count": 1, "min": 0.25931551090623967, "max": 0.25931551090623967}}} #metrics {"StartTime": 1616442588.2937503, "EndTime": 1616442588.2937682, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5969620154648231, "count": 1, "min": 0.5969620154648231, "max": 0.5969620154648231}}} #metrics {"StartTime": 1616442588.2938247, "EndTime": 1616442588.2938428, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5608195955791171, "count": 1, "min": 0.5608195955791171, "max": 0.5608195955791171}}} #metrics {"StartTime": 1616442588.2939005, "EndTime": 1616442588.2939548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6608262238679109, "count": 1, "min": 0.6608262238679109, "max": 0.6608262238679109}}} #metrics {"StartTime": 1616442588.2940128, "EndTime": 1616442588.2940316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6036719266699735, "count": 1, "min": 0.6036719266699735, "max": 0.6036719266699735}}} #metrics {"StartTime": 1616442588.2940967, "EndTime": 1616442588.2941155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2627494045035549, "count": 1, "min": 0.2627494045035549, "max": 0.2627494045035549}}} #metrics {"StartTime": 1616442588.294178, "EndTime": 1616442588.2941985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.25616646822167455, "count": 1, "min": 0.25616646822167455, "max": 0.25616646822167455}}} #metrics {"StartTime": 1616442588.2942605, "EndTime": 1616442588.2942789, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2667674311885127, "count": 1, "min": 0.2667674311885127, "max": 0.2667674311885127}}} #metrics {"StartTime": 1616442588.2943313, "EndTime": 1616442588.2943506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.25877816336495535, "count": 1, "min": 0.25877816336495535, "max": 0.25877816336495535}}} #metrics {"StartTime": 1616442588.2944016, "EndTime": 1616442588.2944214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5706676503337881, "count": 1, "min": 0.5706676503337881, "max": 0.5706676503337881}}} #metrics {"StartTime": 1616442588.2944765, "EndTime": 1616442588.294496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5932104928152901, "count": 1, "min": 0.5932104928152901, "max": 0.5932104928152901}}} #metrics {"StartTime": 1616442588.2945492, "EndTime": 1616442588.2945666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5626754357070519, "count": 1, "min": 0.5626754357070519, "max": 0.5626754357070519}}} #metrics {"StartTime": 1616442588.2946188, "EndTime": 1616442588.2946362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5939412596364501, "count": 1, "min": 0.5939412596364501, "max": 0.5939412596364501}}} #metrics {"StartTime": 1616442588.294699, "EndTime": 1616442588.2947145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4265261856967179, "count": 1, "min": 0.4265261856967179, "max": 0.4265261856967179}}} #metrics {"StartTime": 1616442588.2947686, "EndTime": 1616442588.2947848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4423684821557746, "count": 1, "min": 0.4423684821557746, "max": 0.4423684821557746}}} #metrics {"StartTime": 1616442588.2948394, "EndTime": 1616442588.2948565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44237163079478753, "count": 1, "min": 0.44237163079478753, "max": 0.44237163079478753}}} #metrics {"StartTime": 1616442588.2949102, "EndTime": 1616442588.294927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4276674462373925, "count": 1, "min": 0.4276674462373925, "max": 0.4276674462373925}}} #metrics {"StartTime": 1616442588.2949831, "EndTime": 1616442588.2949991, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6689117270171958, "count": 1, "min": 0.6689117270171958, "max": 0.6689117270171958}}} #metrics {"StartTime": 1616442588.2950528, "EndTime": 1616442588.2950716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7178572397383433, "count": 1, "min": 0.7178572397383433, "max": 0.7178572397383433}}} #metrics {"StartTime": 1616442588.2951334, "EndTime": 1616442588.2951515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.689400486214451, "count": 1, "min": 0.689400486214451, "max": 0.689400486214451}}} #metrics {"StartTime": 1616442588.295202, "EndTime": 1616442588.2952185, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.657654292999752, "count": 1, "min": 0.657654292999752, "max": 0.657654292999752}}} #metrics {"StartTime": 1616442588.2952805, "EndTime": 1616442588.2952979, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7240400364790013, "count": 1, "min": 0.7240400364790013, "max": 0.7240400364790013}}} #metrics {"StartTime": 1616442588.2953513, "EndTime": 1616442588.2953708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7792699097325562, "count": 1, "min": 0.7792699097325562, "max": 0.7792699097325562}}} #metrics {"StartTime": 1616442588.2954235, "EndTime": 1616442588.295441, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7412091613446594, "count": 1, "min": 0.7412091613446594, "max": 0.7412091613446594}}} #metrics {"StartTime": 1616442588.2954974, "EndTime": 1616442588.2955136, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7029431862805886, "count": 1, "min": 0.7029431862805886, "max": 0.7029431862805886}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.6039168746383102 [2021-03-22 19:49:48.442] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 20, "duration": 122, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442588.5746214, "EndTime": 1616442588.5747094, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.605454535233347, "count": 1, "min": 0.605454535233347, "max": 0.605454535233347}}} #metrics {"StartTime": 1616442588.5748062, "EndTime": 1616442588.5748265, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6416205155222039, "count": 1, "min": 0.6416205155222039, "max": 0.6416205155222039}}} #metrics {"StartTime": 1616442588.5748816, "EndTime": 1616442588.574899, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6279606467799137, "count": 1, "min": 0.6279606467799137, "max": 0.6279606467799137}}} #metrics {"StartTime": 1616442588.574949, "EndTime": 1616442588.5749662, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5632429825632196, "count": 1, "min": 0.5632429825632196, "max": 0.5632429825632196}}} #metrics {"StartTime": 1616442588.5750246, "EndTime": 1616442588.5750391, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2706918816817434, "count": 1, "min": 0.2706918816817434, "max": 0.2706918816817434}}} #metrics {"StartTime": 1616442588.5750866, "EndTime": 1616442588.5751014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.271259227551912, "count": 1, "min": 0.271259227551912, "max": 0.271259227551912}}} #metrics {"StartTime": 1616442588.5751512, "EndTime": 1616442588.575168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2665389613101357, "count": 1, "min": 0.2665389613101357, "max": 0.2665389613101357}}} #metrics {"StartTime": 1616442588.575218, "EndTime": 1616442588.575235, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.26815514815481084, "count": 1, "min": 0.26815514815481084, "max": 0.26815514815481084}}} #metrics {"StartTime": 1616442588.5752754, "EndTime": 1616442588.5752916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5861548172800164, "count": 1, "min": 0.5861548172800164, "max": 0.5861548172800164}}} #metrics {"StartTime": 1616442588.5753403, "EndTime": 1616442588.575356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5500216835423519, "count": 1, "min": 0.5500216835423519, "max": 0.5500216835423519}}} #metrics {"StartTime": 1616442588.5754194, "EndTime": 1616442588.5754366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6588829442074424, "count": 1, "min": 0.6588829442074424, "max": 0.6588829442074424}}} #metrics {"StartTime": 1616442588.5754907, "EndTime": 1616442588.5755024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6006480969880756, "count": 1, "min": 0.6006480969880756, "max": 0.6006480969880756}}} #metrics {"StartTime": 1616442588.5755494, "EndTime": 1616442588.5755653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.26302807456568666, "count": 1, "min": 0.26302807456568666, "max": 0.26302807456568666}}} #metrics {"StartTime": 1616442588.5756285, "EndTime": 1616442588.575646, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2653207076223273, "count": 1, "min": 0.2653207076223273, "max": 0.2653207076223273}}} #metrics {"StartTime": 1616442588.5757034, "EndTime": 1616442588.5757205, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.271514892578125, "count": 1, "min": 0.271514892578125, "max": 0.271514892578125}}} #metrics {"StartTime": 1616442588.575784, "EndTime": 1616442588.5758007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2659063640393709, "count": 1, "min": 0.2659063640393709, "max": 0.2659063640393709}}} #metrics {"StartTime": 1616442588.5758638, "EndTime": 1616442588.575881, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5674605921695107, "count": 1, "min": 0.5674605921695107, "max": 0.5674605921695107}}} #metrics {"StartTime": 1616442588.5759277, "EndTime": 1616442588.5759437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5927941573293586, "count": 1, "min": 0.5927941573293586, "max": 0.5927941573293586}}} #metrics {"StartTime": 1616442588.5759947, "EndTime": 1616442588.576011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5565428081311677, "count": 1, "min": 0.5565428081311677, "max": 0.5565428081311677}}} #metrics {"StartTime": 1616442588.5760586, "EndTime": 1616442588.5760753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5791841205797698, "count": 1, "min": 0.5791841205797698, "max": 0.5791841205797698}}} #metrics {"StartTime": 1616442588.5761323, "EndTime": 1616442588.5761487, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.42450963070518094, "count": 1, "min": 0.42450963070518094, "max": 0.42450963070518094}}} #metrics {"StartTime": 1616442588.5761952, "EndTime": 1616442588.576211, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.43030339291221215, "count": 1, "min": 0.43030339291221215, "max": 0.43030339291221215}}} #metrics {"StartTime": 1616442588.5762677, "EndTime": 1616442588.576284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.43370208740234373, "count": 1, "min": 0.43370208740234373, "max": 0.43370208740234373}}} #metrics {"StartTime": 1616442588.576336, "EndTime": 1616442588.5763524, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.418800876015111, "count": 1, "min": 0.418800876015111, "max": 0.418800876015111}}} #metrics {"StartTime": 1616442588.5764143, "EndTime": 1616442588.5764313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6693695068359375, "count": 1, "min": 0.6693695068359375, "max": 0.6693695068359375}}} #metrics {"StartTime": 1616442588.5764847, "EndTime": 1616442588.5764997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7075280440481085, "count": 1, "min": 0.7075280440481085, "max": 0.7075280440481085}}} #metrics {"StartTime": 1616442588.576551, "EndTime": 1616442588.5765667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6886728387129935, "count": 1, "min": 0.6886728387129935, "max": 0.6886728387129935}}} #metrics {"StartTime": 1616442588.5766292, "EndTime": 1616442588.5766475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6586944178531045, "count": 1, "min": 0.6586944178531045, "max": 0.6586944178531045}}} #metrics {"StartTime": 1616442588.576714, "EndTime": 1616442588.576732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7221265290912829, "count": 1, "min": 0.7221265290912829, "max": 0.7221265290912829}}} #metrics {"StartTime": 1616442588.5767956, "EndTime": 1616442588.5768125, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7266681871916119, "count": 1, "min": 0.7266681871916119, "max": 0.7266681871916119}}} #metrics {"StartTime": 1616442588.5768647, "EndTime": 1616442588.5768774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6943222848992598, "count": 1, "min": 0.6943222848992598, "max": 0.6943222848992598}}} #metrics {"StartTime": 1616442588.576907, "EndTime": 1616442588.5769153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6924847251490542, "count": 1, "min": 0.6924847251490542, "max": 0.6924847251490542}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=6, validation binary_classification_cross_entropy_objective <loss>=0.605454535233347 [03/22/2021 19:49:48 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:48 INFO 140389653051200] Epoch 6: Loss improved. Updating best model [03/22/2021 19:49:48 INFO 140389653051200] Saving model for epoch: 6 [03/22/2021 19:49:48 INFO 140389653051200] Saved checkpoint to "/tmp/tmpy4ctbkwd/mx-mod-0000.params" [03/22/2021 19:49:48 INFO 140389653051200] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs #metrics {"StartTime": 1616442588.2561662, "EndTime": 1616442588.5843706, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6804.0, "count": 1, "min": 6804, "max": 6804}, "Total Batches Seen": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:48 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2302.32209337532 records/second [2021-03-22 19:49:48.634] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 18, "duration": 49, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442588.6341615, "EndTime": 1616442588.634274, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5885021068431713, "count": 1, "min": 0.5885021068431713, "max": 0.5885021068431713}}} #metrics {"StartTime": 1616442588.6343956, "EndTime": 1616442588.634419, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6244240412636409, "count": 1, "min": 0.6244240412636409, "max": 0.6244240412636409}}} #metrics {"StartTime": 1616442588.6344767, "EndTime": 1616442588.634493, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6180719446252894, "count": 1, "min": 0.6180719446252894, "max": 0.6180719446252894}}} #metrics {"StartTime": 1616442588.6345503, "EndTime": 1616442588.6345692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5584019252232143, "count": 1, "min": 0.5584019252232143, "max": 0.5584019252232143}}} #metrics {"StartTime": 1616442588.6346307, "EndTime": 1616442588.6346517, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.24262931864097637, "count": 1, "min": 0.24262931864097637, "max": 0.24262931864097637}}} #metrics {"StartTime": 1616442588.6347158, "EndTime": 1616442588.6347346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.24536621255218669, "count": 1, "min": 0.24536621255218669, "max": 0.24536621255218669}}} #metrics {"StartTime": 1616442588.6347954, "EndTime": 1616442588.6348147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.24659517076280382, "count": 1, "min": 0.24659517076280382, "max": 0.24659517076280382}}} #metrics {"StartTime": 1616442588.6348724, "EndTime": 1616442588.6348891, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.242218017578125, "count": 1, "min": 0.242218017578125, "max": 0.242218017578125}}} #metrics {"StartTime": 1616442588.6349485, "EndTime": 1616442588.6349664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5826665081044353, "count": 1, "min": 0.5826665081044353, "max": 0.5826665081044353}}} #metrics {"StartTime": 1616442588.6350205, "EndTime": 1616442588.6350377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5477583950789517, "count": 1, "min": 0.5477583950789517, "max": 0.5477583950789517}}} #metrics {"StartTime": 1616442588.6350942, "EndTime": 1616442588.635112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6434500154364046, "count": 1, "min": 0.6434500154364046, "max": 0.6434500154364046}}} #metrics {"StartTime": 1616442588.635167, "EndTime": 1616442588.6351838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5887062839730076, "count": 1, "min": 0.5887062839730076, "max": 0.5887062839730076}}} #metrics {"StartTime": 1616442588.6352377, "EndTime": 1616442588.6352537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.24591774915261244, "count": 1, "min": 0.24591774915261244, "max": 0.24591774915261244}}} #metrics {"StartTime": 1616442588.6353178, "EndTime": 1616442588.6353347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.23812091161334326, "count": 1, "min": 0.23812091161334326, "max": 0.23812091161334326}}} #metrics {"StartTime": 1616442588.6353836, "EndTime": 1616442588.6353989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.25071318692000455, "count": 1, "min": 0.25071318692000455, "max": 0.25071318692000455}}} #metrics {"StartTime": 1616442588.6354523, "EndTime": 1616442588.6354678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.24090553969933243, "count": 1, "min": 0.24090553969933243, "max": 0.24090553969933243}}} #metrics {"StartTime": 1616442588.635516, "EndTime": 1616442588.63553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5584038224800554, "count": 1, "min": 0.5584038224800554, "max": 0.5584038224800554}}} #metrics {"StartTime": 1616442588.6355786, "EndTime": 1616442588.6355953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5801327014095569, "count": 1, "min": 0.5801327014095569, "max": 0.5801327014095569}}} #metrics {"StartTime": 1616442588.6356442, "EndTime": 1616442588.635658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5503303083793196, "count": 1, "min": 0.5503303083793196, "max": 0.5503303083793196}}} #metrics {"StartTime": 1616442588.635706, "EndTime": 1616442588.635721, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5805839256004051, "count": 1, "min": 0.5805839256004051, "max": 0.5805839256004051}}} #metrics {"StartTime": 1616442588.635767, "EndTime": 1616442588.6357803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.404464600578187, "count": 1, "min": 0.404464600578187, "max": 0.404464600578187}}} #metrics {"StartTime": 1616442588.6358278, "EndTime": 1616442588.6358426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4189313454602761, "count": 1, "min": 0.4189313454602761, "max": 0.4189313454602761}}} #metrics {"StartTime": 1616442588.6358893, "EndTime": 1616442588.6359036, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.41265683451657575, "count": 1, "min": 0.41265683451657575, "max": 0.41265683451657575}}} #metrics {"StartTime": 1616442588.635953, "EndTime": 1616442588.6359677, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4062688918340774, "count": 1, "min": 0.4062688918340774, "max": 0.4062688918340774}}} #metrics {"StartTime": 1616442588.636014, "EndTime": 1616442588.6360276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6728505533208292, "count": 1, "min": 0.6728505533208292, "max": 0.6728505533208292}}} #metrics {"StartTime": 1616442588.6360762, "EndTime": 1616442588.6360912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7101953900049603, "count": 1, "min": 0.7101953900049603, "max": 0.7101953900049603}}} #metrics {"StartTime": 1616442588.6361365, "EndTime": 1616442588.6361496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6907037805627894, "count": 1, "min": 0.6907037805627894, "max": 0.6907037805627894}}} #metrics {"StartTime": 1616442588.6361969, "EndTime": 1616442588.6362104, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6622725390883349, "count": 1, "min": 0.6622725390883349, "max": 0.6622725390883349}}} #metrics {"StartTime": 1616442588.6362545, "EndTime": 1616442588.6362686, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7292545863560268, "count": 1, "min": 0.7292545863560268, "max": 0.7292545863560268}}} #metrics {"StartTime": 1616442588.636318, "EndTime": 1616442588.6363342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7263055226159474, "count": 1, "min": 0.7263055226159474, "max": 0.7263055226159474}}} #metrics {"StartTime": 1616442588.636387, "EndTime": 1616442588.6364043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6969620639054233, "count": 1, "min": 0.6969620639054233, "max": 0.6969620639054233}}} #metrics {"StartTime": 1616442588.6364565, "EndTime": 1616442588.636472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6917895766162367, "count": 1, "min": 0.6917895766162367, "max": 0.6917895766162367}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.5885021068431713 [2021-03-22 19:49:48.783] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 23, "duration": 116, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442588.9306705, "EndTime": 1616442588.9307463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.591748689350329, "count": 1, "min": 0.591748689350329, "max": 0.591748689350329}}} #metrics {"StartTime": 1616442588.9308386, "EndTime": 1616442588.9308538, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6263288799085115, "count": 1, "min": 0.6263288799085115, "max": 0.6263288799085115}}} #metrics {"StartTime": 1616442588.930918, "EndTime": 1616442588.930933, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6130367078279194, "count": 1, "min": 0.6130367078279194, "max": 0.6130367078279194}}} #metrics {"StartTime": 1616442588.930996, "EndTime": 1616442588.931016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.551494678698088, "count": 1, "min": 0.551494678698088, "max": 0.551494678698088}}} #metrics {"StartTime": 1616442588.931078, "EndTime": 1616442588.9310958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2577545166015625, "count": 1, "min": 0.2577545166015625, "max": 0.2577545166015625}}} #metrics {"StartTime": 1616442588.931147, "EndTime": 1616442588.9311624, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25976992155376233, "count": 1, "min": 0.25976992155376233, "max": 0.25976992155376233}}} #metrics {"StartTime": 1616442588.9312243, "EndTime": 1616442588.93124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25310488249126234, "count": 1, "min": 0.25310488249126234, "max": 0.25310488249126234}}} #metrics {"StartTime": 1616442588.9313054, "EndTime": 1616442588.931325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25396447432668584, "count": 1, "min": 0.25396447432668584, "max": 0.25396447432668584}}} #metrics {"StartTime": 1616442588.9313905, "EndTime": 1616442588.93141, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5738958659924959, "count": 1, "min": 0.5738958659924959, "max": 0.5738958659924959}}} #metrics {"StartTime": 1616442588.9314811, "EndTime": 1616442588.9314976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.538784388491982, "count": 1, "min": 0.538784388491982, "max": 0.538784388491982}}} #metrics {"StartTime": 1616442588.9315653, "EndTime": 1616442588.9315848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6432604739540502, "count": 1, "min": 0.6432604739540502, "max": 0.6432604739540502}}} #metrics {"StartTime": 1616442588.9316409, "EndTime": 1616442588.931658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.587063960025185, "count": 1, "min": 0.587063960025185, "max": 0.587063960025185}}} #metrics {"StartTime": 1616442588.931712, "EndTime": 1616442588.9317312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25269048590409127, "count": 1, "min": 0.25269048590409127, "max": 0.25269048590409127}}} #metrics {"StartTime": 1616442588.9317966, "EndTime": 1616442588.931816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25252647399902345, "count": 1, "min": 0.25252647399902345, "max": 0.25252647399902345}}} #metrics {"StartTime": 1616442588.9318705, "EndTime": 1616442588.9318883, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2594182466205798, "count": 1, "min": 0.2594182466205798, "max": 0.2594182466205798}}} #metrics {"StartTime": 1616442588.9319544, "EndTime": 1616442588.9319754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25200958251953126, "count": 1, "min": 0.25200958251953126, "max": 0.25200958251953126}}} #metrics {"StartTime": 1616442588.9320428, "EndTime": 1616442588.932061, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5566342805561266, "count": 1, "min": 0.5566342805561266, "max": 0.5566342805561266}}} #metrics {"StartTime": 1616442588.932118, "EndTime": 1616442588.9321342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5808300620631168, "count": 1, "min": 0.5808300620631168, "max": 0.5808300620631168}}} #metrics {"StartTime": 1616442588.9321876, "EndTime": 1616442588.9322052, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5466660348992599, "count": 1, "min": 0.5466660348992599, "max": 0.5466660348992599}}} #metrics {"StartTime": 1616442588.932273, "EndTime": 1616442588.9322941, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5691949141652961, "count": 1, "min": 0.5691949141652961, "max": 0.5691949141652961}}} #metrics {"StartTime": 1616442588.9323533, "EndTime": 1616442588.932369, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41722468325966283, "count": 1, "min": 0.41722468325966283, "max": 0.41722468325966283}}} #metrics {"StartTime": 1616442588.9324107, "EndTime": 1616442588.9324236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4286135623329564, "count": 1, "min": 0.4286135623329564, "max": 0.4286135623329564}}} #metrics {"StartTime": 1616442588.9324732, "EndTime": 1616442588.932492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.432426613255551, "count": 1, "min": 0.432426613255551, "max": 0.432426613255551}}} #metrics {"StartTime": 1616442588.9325523, "EndTime": 1616442588.932567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.41606164229543585, "count": 1, "min": 0.41606164229543585, "max": 0.41606164229543585}}} #metrics {"StartTime": 1616442588.9326239, "EndTime": 1616442588.9326391, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6736425299393504, "count": 1, "min": 0.6736425299393504, "max": 0.6736425299393504}}} #metrics {"StartTime": 1616442588.9327035, "EndTime": 1616442588.9327204, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7005448993883635, "count": 1, "min": 0.7005448993883635, "max": 0.7005448993883635}}} #metrics {"StartTime": 1616442588.932775, "EndTime": 1616442588.9327931, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.691027189555921, "count": 1, "min": 0.691027189555921, "max": 0.691027189555921}}} #metrics {"StartTime": 1616442588.9328532, "EndTime": 1616442588.9328723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6640157599198191, "count": 1, "min": 0.6640157599198191, "max": 0.6640157599198191}}} #metrics {"StartTime": 1616442588.9329236, "EndTime": 1616442588.9329438, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7365250436883224, "count": 1, "min": 0.7365250436883224, "max": 0.7365250436883224}}} #metrics {"StartTime": 1616442588.9329948, "EndTime": 1616442588.9330122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7023792467619243, "count": 1, "min": 0.7023792467619243, "max": 0.7023792467619243}}} #metrics {"StartTime": 1616442588.933072, "EndTime": 1616442588.9330866, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6818319220291941, "count": 1, "min": 0.6818319220291941, "max": 0.6818319220291941}}} #metrics {"StartTime": 1616442588.933151, "EndTime": 1616442588.933168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7085173757452714, "count": 1, "min": 0.7085173757452714, "max": 0.7085173757452714}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=7, validation binary_classification_cross_entropy_objective <loss>=0.591748689350329 [03/22/2021 19:49:48 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:48 INFO 140389653051200] Epoch 7: Loss improved. Updating best model [03/22/2021 19:49:48 INFO 140389653051200] Saving model for epoch: 7 [03/22/2021 19:49:48 INFO 140389653051200] Saved checkpoint to "/tmp/tmpgaf8xy6v/mx-mod-0000.params" [03/22/2021 19:49:48 INFO 140389653051200] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs #metrics {"StartTime": 1616442588.5847085, "EndTime": 1616442588.9409401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 7560.0, "count": 1, "min": 7560, "max": 7560}, "Total Batches Seen": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:48 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2121.338343721839 records/second [2021-03-22 19:49:48.982] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 20, "duration": 40, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442588.982352, "EndTime": 1616442588.9824462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5740083563264715, "count": 1, "min": 0.5740083563264715, "max": 0.5740083563264715}}} #metrics {"StartTime": 1616442588.9825454, "EndTime": 1616442588.982562, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6084476450763682, "count": 1, "min": 0.6084476450763682, "max": 0.6084476450763682}}} #metrics {"StartTime": 1616442588.9826076, "EndTime": 1616442588.98262, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.601593744187128, "count": 1, "min": 0.601593744187128, "max": 0.601593744187128}}} #metrics {"StartTime": 1616442588.9826708, "EndTime": 1616442588.9826834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.545544740384218, "count": 1, "min": 0.545544740384218, "max": 0.545544740384218}}} #metrics {"StartTime": 1616442588.982726, "EndTime": 1616442588.982738, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22891055717670097, "count": 1, "min": 0.22891055717670097, "max": 0.22891055717670097}}} #metrics {"StartTime": 1616442588.9827785, "EndTime": 1616442588.9827895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2312373610400649, "count": 1, "min": 0.2312373610400649, "max": 0.2312373610400649}}} #metrics {"StartTime": 1616442588.982832, "EndTime": 1616442588.9828432, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2328038694997313, "count": 1, "min": 0.2328038694997313, "max": 0.2328038694997313}}} #metrics {"StartTime": 1616442588.982892, "EndTime": 1616442588.982904, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22753825515666337, "count": 1, "min": 0.22753825515666337, "max": 0.22753825515666337}}} #metrics {"StartTime": 1616442588.9829443, "EndTime": 1616442588.9829555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5692230709015377, "count": 1, "min": 0.5692230709015377, "max": 0.5692230709015377}}} #metrics {"StartTime": 1616442588.9830039, "EndTime": 1616442588.983016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5355304536365327, "count": 1, "min": 0.5355304536365327, "max": 0.5355304536365327}}} #metrics {"StartTime": 1616442588.9830577, "EndTime": 1616442588.9830692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6270751145781663, "count": 1, "min": 0.6270751145781663, "max": 0.6270751145781663}}} #metrics {"StartTime": 1616442588.9831078, "EndTime": 1616442588.9831188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5746501942791006, "count": 1, "min": 0.5746501942791006, "max": 0.5746501942791006}}} #metrics {"StartTime": 1616442588.9831572, "EndTime": 1616442588.9831703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.23224276588076637, "count": 1, "min": 0.23224276588076637, "max": 0.23224276588076637}}} #metrics {"StartTime": 1616442588.9832177, "EndTime": 1616442588.9832318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22226174167855076, "count": 1, "min": 0.22226174167855076, "max": 0.22226174167855076}}} #metrics {"StartTime": 1616442588.983281, "EndTime": 1616442588.983292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.23805422505373677, "count": 1, "min": 0.23805422505373677, "max": 0.23805422505373677}}} #metrics {"StartTime": 1616442588.9833405, "EndTime": 1616442588.9833508, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22560103482039517, "count": 1, "min": 0.22560103482039517, "max": 0.22560103482039517}}} #metrics {"StartTime": 1616442588.9833865, "EndTime": 1616442588.9833956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5470177786690849, "count": 1, "min": 0.5470177786690849, "max": 0.5470177786690849}}} #metrics {"StartTime": 1616442588.9834404, "EndTime": 1616442588.9834566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5679908227668238, "count": 1, "min": 0.5679908227668238, "max": 0.5679908227668238}}} #metrics {"StartTime": 1616442588.983513, "EndTime": 1616442588.98353, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5389435783265129, "count": 1, "min": 0.5389435783265129, "max": 0.5389435783265129}}} #metrics {"StartTime": 1616442588.9835792, "EndTime": 1616442588.9835958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5682041228763641, "count": 1, "min": 0.5682041228763641, "max": 0.5682041228763641}}} #metrics {"StartTime": 1616442588.9836595, "EndTime": 1616442588.9836774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.3993605760039476, "count": 1, "min": 0.3993605760039476, "max": 0.3993605760039476}}} #metrics {"StartTime": 1616442588.9837296, "EndTime": 1616442588.9837463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4150238037109375, "count": 1, "min": 0.4150238037109375, "max": 0.4150238037109375}}} #metrics {"StartTime": 1616442588.983796, "EndTime": 1616442588.9838064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.41159138351521163, "count": 1, "min": 0.41159138351521163, "max": 0.41159138351521163}}} #metrics {"StartTime": 1616442588.9838421, "EndTime": 1616442588.9838548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4034659572379299, "count": 1, "min": 0.4034659572379299, "max": 0.4034659572379299}}} #metrics {"StartTime": 1616442588.9839053, "EndTime": 1616442588.9839213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6761238865120701, "count": 1, "min": 0.6761238865120701, "max": 0.6761238865120701}}} #metrics {"StartTime": 1616442588.9839656, "EndTime": 1616442588.9839761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7026616656591022, "count": 1, "min": 0.7026616656591022, "max": 0.7026616656591022}}} #metrics {"StartTime": 1616442588.9840925, "EndTime": 1616442588.9841082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6918268758783895, "count": 1, "min": 0.6918268758783895, "max": 0.6918268758783895}}} #metrics {"StartTime": 1616442588.9841712, "EndTime": 1616442588.9841874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6668929650039269, "count": 1, "min": 0.6668929650039269, "max": 0.6668929650039269}}} #metrics {"StartTime": 1616442588.98425, "EndTime": 1616442588.9842665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7436259436228919, "count": 1, "min": 0.7436259436228919, "max": 0.7436259436228919}}} #metrics {"StartTime": 1616442588.9843254, "EndTime": 1616442588.9843395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6966888589203042, "count": 1, "min": 0.6966888589203042, "max": 0.6966888589203042}}} #metrics {"StartTime": 1616442588.9844022, "EndTime": 1616442588.9844203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6830494391224372, "count": 1, "min": 0.6830494391224372, "max": 0.6830494391224372}}} #metrics {"StartTime": 1616442588.9844816, "EndTime": 1616442588.984497, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7087946493158895, "count": 1, "min": 0.7087946493158895, "max": 0.7087946493158895}}} [03/22/2021 19:49:48 INFO 140389653051200] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.5740083563264715 [2021-03-22 19:49:49.124] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 26, "duration": 117, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442589.2777777, "EndTime": 1616442589.2778523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5786693773771587, "count": 1, "min": 0.5786693773771587, "max": 0.5786693773771587}}} #metrics {"StartTime": 1616442589.2779753, "EndTime": 1616442589.2779932, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.611575678775185, "count": 1, "min": 0.611575678775185, "max": 0.611575678775185}}} #metrics {"StartTime": 1616442589.2780578, "EndTime": 1616442589.2780733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5987200285259046, "count": 1, "min": 0.5987200285259046, "max": 0.5987200285259046}}} #metrics {"StartTime": 1616442589.278127, "EndTime": 1616442589.2781444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5402247378700658, "count": 1, "min": 0.5402247378700658, "max": 0.5402247378700658}}} #metrics {"StartTime": 1616442589.2782054, "EndTime": 1616442589.278225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2508444133557771, "count": 1, "min": 0.2508444133557771, "max": 0.2508444133557771}}} #metrics {"StartTime": 1616442589.278285, "EndTime": 1616442589.278304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2542488499691612, "count": 1, "min": 0.2542488499691612, "max": 0.2542488499691612}}} #metrics {"StartTime": 1616442589.278364, "EndTime": 1616442589.278384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24609929134971217, "count": 1, "min": 0.24609929134971217, "max": 0.24609929134971217}}} #metrics {"StartTime": 1616442589.2784398, "EndTime": 1616442589.2784572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2461360730622944, "count": 1, "min": 0.2461360730622944, "max": 0.2461360730622944}}} #metrics {"StartTime": 1616442589.2785237, "EndTime": 1616442589.2785435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5621944226716694, "count": 1, "min": 0.5621944226716694, "max": 0.5621944226716694}}} #metrics {"StartTime": 1616442589.27861, "EndTime": 1616442589.2786317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.528101951197574, "count": 1, "min": 0.528101951197574, "max": 0.528101951197574}}} #metrics {"StartTime": 1616442589.2786965, "EndTime": 1616442589.2787156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6281963147615132, "count": 1, "min": 0.6281963147615132, "max": 0.6281963147615132}}} #metrics {"StartTime": 1616442589.2787833, "EndTime": 1616442589.2787993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5739576239334909, "count": 1, "min": 0.5739576239334909, "max": 0.5739576239334909}}} #metrics {"StartTime": 1616442589.278865, "EndTime": 1616442589.2788842, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24815906725431744, "count": 1, "min": 0.24815906725431744, "max": 0.24815906725431744}}} #metrics {"StartTime": 1616442589.2789452, "EndTime": 1616442589.2789638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24641498766447367, "count": 1, "min": 0.24641498766447367, "max": 0.24641498766447367}}} #metrics {"StartTime": 1616442589.2790356, "EndTime": 1616442589.2790544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.25298510099712174, "count": 1, "min": 0.25298510099712174, "max": 0.25298510099712174}}} #metrics {"StartTime": 1616442589.2791262, "EndTime": 1616442589.279144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24530420805278577, "count": 1, "min": 0.24530420805278577, "max": 0.24530420805278577}}} #metrics {"StartTime": 1616442589.2792006, "EndTime": 1616442589.2792182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5464305676912007, "count": 1, "min": 0.5464305676912007, "max": 0.5464305676912007}}} #metrics {"StartTime": 1616442589.2792575, "EndTime": 1616442589.2792706, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5694099827816612, "count": 1, "min": 0.5694099827816612, "max": 0.5694099827816612}}} #metrics {"StartTime": 1616442589.2793143, "EndTime": 1616442589.2793248, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5373528731496711, "count": 1, "min": 0.5373528731496711, "max": 0.5373528731496711}}} #metrics {"StartTime": 1616442589.279363, "EndTime": 1616442589.2793782, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5597334209241365, "count": 1, "min": 0.5597334209241365, "max": 0.5597334209241365}}} #metrics {"StartTime": 1616442589.2794394, "EndTime": 1616442589.279457, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4407949347245066, "count": 1, "min": 0.4407949347245066, "max": 0.4407949347245066}}} #metrics {"StartTime": 1616442589.2795138, "EndTime": 1616442589.2795317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4631711056357936, "count": 1, "min": 0.4631711056357936, "max": 0.4631711056357936}}} #metrics {"StartTime": 1616442589.2795863, "EndTime": 1616442589.2796018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4624985945852179, "count": 1, "min": 0.4624985945852179, "max": 0.4624985945852179}}} #metrics {"StartTime": 1616442589.279655, "EndTime": 1616442589.2796736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4462408768503289, "count": 1, "min": 0.4462408768503289, "max": 0.4462408768503289}}} #metrics {"StartTime": 1616442589.2797415, "EndTime": 1616442589.2797616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.677102982370477, "count": 1, "min": 0.677102982370477, "max": 0.677102982370477}}} #metrics {"StartTime": 1616442589.2798193, "EndTime": 1616442589.2798357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6935741223787006, "count": 1, "min": 0.6935741223787006, "max": 0.6935741223787006}}} #metrics {"StartTime": 1616442589.2798889, "EndTime": 1616442589.2799065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6929819207442435, "count": 1, "min": 0.6929819207442435, "max": 0.6929819207442435}}} #metrics {"StartTime": 1616442589.2799644, "EndTime": 1616442589.2799807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.669141267475329, "count": 1, "min": 0.669141267475329, "max": 0.669141267475329}}} #metrics {"StartTime": 1616442589.2800367, "EndTime": 1616442589.280054, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7366852609734786, "count": 1, "min": 0.7366852609734786, "max": 0.7366852609734786}}} #metrics {"StartTime": 1616442589.280108, "EndTime": 1616442589.2801244, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6876137181332237, "count": 1, "min": 0.6876137181332237, "max": 0.6876137181332237}}} #metrics {"StartTime": 1616442589.2801793, "EndTime": 1616442589.2801955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6813645212273849, "count": 1, "min": 0.6813645212273849, "max": 0.6813645212273849}}} #metrics {"StartTime": 1616442589.2802584, "EndTime": 1616442589.280277, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7207259328741776, "count": 1, "min": 0.7207259328741776, "max": 0.7207259328741776}}} [03/22/2021 19:49:49 INFO 140389653051200] #quality_metric: host=algo-1, epoch=8, validation binary_classification_cross_entropy_objective <loss>=0.5786693773771587 [03/22/2021 19:49:49 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:49 INFO 140389653051200] Epoch 8: Loss improved. Updating best model [03/22/2021 19:49:49 INFO 140389653051200] Saving model for epoch: 8 [03/22/2021 19:49:49 INFO 140389653051200] Saved checkpoint to "/tmp/tmpb8tug33g/mx-mod-0000.params" [03/22/2021 19:49:49 INFO 140389653051200] #progress_metric: host=algo-1, completed 60.0 % of epochs #metrics {"StartTime": 1616442588.9412687, "EndTime": 1616442589.2880964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 8316.0, "count": 1, "min": 8316, "max": 8316}, "Total Batches Seen": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:49 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2178.8891649716893 records/second [2021-03-22 19:49:49.330] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 22, "duration": 42, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442589.3307729, "EndTime": 1616442589.3308728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5603347859054646, "count": 1, "min": 0.5603347859054646, "max": 0.5603347859054646}}} #metrics {"StartTime": 1616442589.3309758, "EndTime": 1616442589.3311014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5933783394949776, "count": 1, "min": 0.5933783394949776, "max": 0.5933783394949776}}} #metrics {"StartTime": 1616442589.3311648, "EndTime": 1616442589.3312435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5860310710927166, "count": 1, "min": 0.5860310710927166, "max": 0.5860310710927166}}} #metrics {"StartTime": 1616442589.3313, "EndTime": 1616442589.3313165, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5334177975932126, "count": 1, "min": 0.5334177975932126, "max": 0.5334177975932126}}} #metrics {"StartTime": 1616442589.331427, "EndTime": 1616442589.3314452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2208167182074653, "count": 1, "min": 0.2208167182074653, "max": 0.2208167182074653}}} #metrics {"StartTime": 1616442589.3314908, "EndTime": 1616442589.3315053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22289833189949157, "count": 1, "min": 0.22289833189949157, "max": 0.22289833189949157}}} #metrics {"StartTime": 1616442589.3316255, "EndTime": 1616442589.3316412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22472458289413855, "count": 1, "min": 0.22472458289413855, "max": 0.22472458289413855}}} #metrics {"StartTime": 1616442589.331691, "EndTime": 1616442589.331702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21884197658962673, "count": 1, "min": 0.21884197658962673, "max": 0.21884197658962673}}} #metrics {"StartTime": 1616442589.331738, "EndTime": 1616442589.3317537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.556528646479208, "count": 1, "min": 0.556528646479208, "max": 0.556528646479208}}} #metrics {"StartTime": 1616442589.3318048, "EndTime": 1616442589.331821, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5240199982173859, "count": 1, "min": 0.5240199982173859, "max": 0.5240199982173859}}} #metrics {"StartTime": 1616442589.331865, "EndTime": 1616442589.3318815, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6116055685376364, "count": 1, "min": 0.6116055685376364, "max": 0.6116055685376364}}} #metrics {"StartTime": 1616442589.3319242, "EndTime": 1616442589.3319345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5613951910109747, "count": 1, "min": 0.5613951910109747, "max": 0.5613951910109747}}} #metrics {"StartTime": 1616442589.3319626, "EndTime": 1616442589.331971, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22380661333679522, "count": 1, "min": 0.22380661333679522, "max": 0.22380661333679522}}} #metrics {"StartTime": 1616442589.3320098, "EndTime": 1616442589.332025, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2125989520360553, "count": 1, "min": 0.2125989520360553, "max": 0.2125989520360553}}} #metrics {"StartTime": 1616442589.332078, "EndTime": 1616442589.3320935, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.23038882300967262, "count": 1, "min": 0.23038882300967262, "max": 0.23038882300967262}}} #metrics {"StartTime": 1616442589.3321452, "EndTime": 1616442589.332161, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21637990235020874, "count": 1, "min": 0.21637990235020874, "max": 0.21637990235020874}}} #metrics {"StartTime": 1616442589.3321934, "EndTime": 1616442589.3322017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5364362121259094, "count": 1, "min": 0.5364362121259094, "max": 0.5364362121259094}}} #metrics {"StartTime": 1616442589.3322282, "EndTime": 1616442589.3322363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5566874509135251, "count": 1, "min": 0.5566874509135251, "max": 0.5566874509135251}}} #metrics {"StartTime": 1616442589.332262, "EndTime": 1616442589.3322701, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5283914798151248, "count": 1, "min": 0.5283914798151248, "max": 0.5283914798151248}}} #metrics {"StartTime": 1616442589.332313, "EndTime": 1616442589.3323298, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5566489406363674, "count": 1, "min": 0.5566489406363674, "max": 0.5566489406363674}}} #metrics {"StartTime": 1616442589.3323793, "EndTime": 1616442589.3323946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.42449369884672616, "count": 1, "min": 0.42449369884672616, "max": 0.42449369884672616}}} #metrics {"StartTime": 1616442589.3324454, "EndTime": 1616442589.3324628, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4462032015361483, "count": 1, "min": 0.4462032015361483, "max": 0.4462032015361483}}} #metrics {"StartTime": 1616442589.332494, "EndTime": 1616442589.3325028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44216822064112105, "count": 1, "min": 0.44216822064112105, "max": 0.44216822064112105}}} #metrics {"StartTime": 1616442589.3325305, "EndTime": 1616442589.332538, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.43158947979962387, "count": 1, "min": 0.43158947979962387, "max": 0.43158947979962387}}} #metrics {"StartTime": 1616442589.3325648, "EndTime": 1616442589.3325725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6786839722325562, "count": 1, "min": 0.6786839722325562, "max": 0.6786839722325562}}} #metrics {"StartTime": 1616442589.3326, "EndTime": 1616442589.3326151, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6952063343512318, "count": 1, "min": 0.6952063343512318, "max": 0.6952063343512318}}} #metrics {"StartTime": 1616442589.3326702, "EndTime": 1616442589.3326879, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6926745863818617, "count": 1, "min": 0.6926745863818617, "max": 0.6926745863818617}}} #metrics {"StartTime": 1616442589.3327425, "EndTime": 1616442589.3327606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6713425167023189, "count": 1, "min": 0.6713425167023189, "max": 0.6713425167023189}}} #metrics {"StartTime": 1616442589.3328118, "EndTime": 1616442589.3328252, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7396891760447669, "count": 1, "min": 0.7396891760447669, "max": 0.7396891760447669}}} #metrics {"StartTime": 1616442589.3328807, "EndTime": 1616442589.332898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.67844564447958, "count": 1, "min": 0.67844564447958, "max": 0.67844564447958}}} #metrics {"StartTime": 1616442589.3329434, "EndTime": 1616442589.3329608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6802503797743056, "count": 1, "min": 0.6802503797743056, "max": 0.6802503797743056}}} #metrics {"StartTime": 1616442589.3330204, "EndTime": 1616442589.3330388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7217754384197256, "count": 1, "min": 0.7217754384197256, "max": 0.7217754384197256}}} [03/22/2021 19:49:49 INFO 140389653051200] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.5603347859054646 [2021-03-22 19:49:49.498] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 29, "duration": 133, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442589.6263723, "EndTime": 1616442589.6264474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5661861218904194, "count": 1, "min": 0.5661861218904194, "max": 0.5661861218904194}}} #metrics {"StartTime": 1616442589.6265442, "EndTime": 1616442589.6265602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5973555715460527, "count": 1, "min": 0.5973555715460527, "max": 0.5973555715460527}}} #metrics {"StartTime": 1616442589.6266298, "EndTime": 1616442589.626647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5849733051500823, "count": 1, "min": 0.5849733051500823, "max": 0.5849733051500823}}} #metrics {"StartTime": 1616442589.6267078, "EndTime": 1616442589.6267257, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5294120387027138, "count": 1, "min": 0.5294120387027138, "max": 0.5294120387027138}}} #metrics {"StartTime": 1616442589.6267831, "EndTime": 1616442589.626803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24848576595908717, "count": 1, "min": 0.24848576595908717, "max": 0.24848576595908717}}} #metrics {"StartTime": 1616442589.6268597, "EndTime": 1616442589.6268766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2531217273912932, "count": 1, "min": 0.2531217273912932, "max": 0.2531217273912932}}} #metrics {"StartTime": 1616442589.6269393, "EndTime": 1616442589.6269588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24368729842336553, "count": 1, "min": 0.24368729842336553, "max": 0.24368729842336553}}} #metrics {"StartTime": 1616442589.627007, "EndTime": 1616442589.6270225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24312924836811267, "count": 1, "min": 0.24312924836811267, "max": 0.24312924836811267}}} #metrics {"StartTime": 1616442589.6270723, "EndTime": 1616442589.6270874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5510249087685033, "count": 1, "min": 0.5510249087685033, "max": 0.5510249087685033}}} #metrics {"StartTime": 1616442589.627136, "EndTime": 1616442589.6271517, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5179238570363898, "count": 1, "min": 0.5179238570363898, "max": 0.5179238570363898}}} #metrics {"StartTime": 1616442589.6272187, "EndTime": 1616442589.6272378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.613672597784745, "count": 1, "min": 0.613672597784745, "max": 0.613672597784745}}} #metrics {"StartTime": 1616442589.6273003, "EndTime": 1616442589.627316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5613338269685444, "count": 1, "min": 0.5613338269685444, "max": 0.5613338269685444}}} #metrics {"StartTime": 1616442589.6273863, "EndTime": 1616442589.6274047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24756136442485607, "count": 1, "min": 0.24756136442485607, "max": 0.24756136442485607}}} #metrics {"StartTime": 1616442589.6274617, "EndTime": 1616442589.6274805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24509719045538653, "count": 1, "min": 0.24509719045538653, "max": 0.24509719045538653}}} #metrics {"StartTime": 1616442589.6275482, "EndTime": 1616442589.6275668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2504963523463199, "count": 1, "min": 0.2504963523463199, "max": 0.2504963523463199}}} #metrics {"StartTime": 1616442589.6276255, "EndTime": 1616442589.6276405, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24386502316123562, "count": 1, "min": 0.24386502316123562, "max": 0.24386502316123562}}} #metrics {"StartTime": 1616442589.6277099, "EndTime": 1616442589.6277304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5368202209472657, "count": 1, "min": 0.5368202209472657, "max": 0.5368202209472657}}} #metrics {"StartTime": 1616442589.6277823, "EndTime": 1616442589.6278002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5585526315789474, "count": 1, "min": 0.5585526315789474, "max": 0.5585526315789474}}} #metrics {"StartTime": 1616442589.627851, "EndTime": 1616442589.6278684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5285587913111637, "count": 1, "min": 0.5285587913111637, "max": 0.5285587913111637}}} #metrics {"StartTime": 1616442589.6279242, "EndTime": 1616442589.6279376, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5507195723684211, "count": 1, "min": 0.5507195723684211, "max": 0.5507195723684211}}} #metrics {"StartTime": 1616442589.6279883, "EndTime": 1616442589.6280031, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.48369361475894324, "count": 1, "min": 0.48369361475894324, "max": 0.48369361475894324}}} #metrics {"StartTime": 1616442589.6280677, "EndTime": 1616442589.6280844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.515265575208162, "count": 1, "min": 0.515265575208162, "max": 0.515265575208162}}} #metrics {"StartTime": 1616442589.6281412, "EndTime": 1616442589.6281598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.496876365260074, "count": 1, "min": 0.496876365260074, "max": 0.496876365260074}}} #metrics {"StartTime": 1616442589.628227, "EndTime": 1616442589.6282468, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4921007658305921, "count": 1, "min": 0.4921007658305921, "max": 0.4921007658305921}}} #metrics {"StartTime": 1616442589.6283169, "EndTime": 1616442589.6283348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6798290051912007, "count": 1, "min": 0.6798290051912007, "max": 0.6798290051912007}}} #metrics {"StartTime": 1616442589.628396, "EndTime": 1616442589.6284134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6868338333932977, "count": 1, "min": 0.6868338333932977, "max": 0.6868338333932977}}} #metrics {"StartTime": 1616442589.6284645, "EndTime": 1616442589.6284823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.694338668020148, "count": 1, "min": 0.694338668020148, "max": 0.694338668020148}}} #metrics {"StartTime": 1616442589.628546, "EndTime": 1616442589.6285667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6739661768863076, "count": 1, "min": 0.6739661768863076, "max": 0.6739661768863076}}} #metrics {"StartTime": 1616442589.628635, "EndTime": 1616442589.6286557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7126271298057154, "count": 1, "min": 0.7126271298057154, "max": 0.7126271298057154}}} #metrics {"StartTime": 1616442589.628714, "EndTime": 1616442589.6287334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6690591912520559, "count": 1, "min": 0.6690591912520559, "max": 0.6690591912520559}}} #metrics {"StartTime": 1616442589.6287854, "EndTime": 1616442589.6288033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6783077842310855, "count": 1, "min": 0.6783077842310855, "max": 0.6783077842310855}}} #metrics {"StartTime": 1616442589.628834, "EndTime": 1616442589.6288435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7130514044510691, "count": 1, "min": 0.7130514044510691, "max": 0.7130514044510691}}} [03/22/2021 19:49:49 INFO 140389653051200] #quality_metric: host=algo-1, epoch=9, validation binary_classification_cross_entropy_objective <loss>=0.5661861218904194 [03/22/2021 19:49:49 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:49 INFO 140389653051200] Epoch 9: Loss improved. Updating best model [03/22/2021 19:49:49 INFO 140389653051200] Saving model for epoch: 9 [03/22/2021 19:49:49 INFO 140389653051200] Saved checkpoint to "/tmp/tmpdzlx5728/mx-mod-0000.params" [03/22/2021 19:49:49 INFO 140389653051200] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs #metrics {"StartTime": 1616442589.2884114, "EndTime": 1616442589.6359515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 9072.0, "count": 1, "min": 9072, "max": 9072}, "Total Batches Seen": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:49 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2174.3381274145836 records/second [2021-03-22 19:49:49.679] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 24, "duration": 43, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442589.6796947, "EndTime": 1616442589.6797855, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5474355384786292, "count": 1, "min": 0.5474355384786292, "max": 0.5474355384786292}}} #metrics {"StartTime": 1616442589.6798842, "EndTime": 1616442589.6799023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5791676839192709, "count": 1, "min": 0.5791676839192709, "max": 0.5791676839192709}}} #metrics {"StartTime": 1616442589.6799483, "EndTime": 1616442589.6799612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5713389966853712, "count": 1, "min": 0.5713389966853712, "max": 0.5713389966853712}}} #metrics {"StartTime": 1616442589.6800046, "EndTime": 1616442589.6800158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5219686195333167, "count": 1, "min": 0.5219686195333167, "max": 0.5219686195333167}}} #metrics {"StartTime": 1616442589.680054, "EndTime": 1616442589.6800654, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21697804284474206, "count": 1, "min": 0.21697804284474206, "max": 0.21697804284474206}}} #metrics {"StartTime": 1616442589.6801047, "EndTime": 1616442589.6801178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21878156712446264, "count": 1, "min": 0.21878156712446264, "max": 0.21878156712446264}}} #metrics {"StartTime": 1616442589.6801674, "EndTime": 1616442589.6801803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22062033194082756, "count": 1, "min": 0.22062033194082756, "max": 0.22062033194082756}}} #metrics {"StartTime": 1616442589.6802297, "EndTime": 1616442589.680242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21464300407934442, "count": 1, "min": 0.21464300407934442, "max": 0.21464300407934442}}} #metrics {"StartTime": 1616442589.6802824, "EndTime": 1616442589.6802962, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5445371355329242, "count": 1, "min": 0.5445371355329242, "max": 0.5445371355329242}}} #metrics {"StartTime": 1616442589.6803346, "EndTime": 1616442589.680345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5131640964084201, "count": 1, "min": 0.5131640964084201, "max": 0.5131640964084201}}} #metrics {"StartTime": 1616442589.6803956, "EndTime": 1616442589.6804047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5969956816819609, "count": 1, "min": 0.5969956816819609, "max": 0.5969956816819609}}} #metrics {"StartTime": 1616442589.6804452, "EndTime": 1616442589.6804578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5488892812577505, "count": 1, "min": 0.5488892812577505, "max": 0.5488892812577505}}} #metrics {"StartTime": 1616442589.6804967, "EndTime": 1616442589.680507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21890097320395172, "count": 1, "min": 0.21890097320395172, "max": 0.21890097320395172}}} #metrics {"StartTime": 1616442589.6805458, "EndTime": 1616442589.6805584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20775676908947172, "count": 1, "min": 0.20775676908947172, "max": 0.20775676908947172}}} #metrics {"StartTime": 1616442589.6806097, "EndTime": 1616442589.6806264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2259579411259404, "count": 1, "min": 0.2259579411259404, "max": 0.2259579411259404}}} #metrics {"StartTime": 1616442589.6806808, "EndTime": 1616442589.680696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21182115746553612, "count": 1, "min": 0.21182115746553612, "max": 0.21182115746553612}}} #metrics {"StartTime": 1616442589.6807652, "EndTime": 1616442589.6807802, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.526614436396846, "count": 1, "min": 0.526614436396846, "max": 0.526614436396846}}} #metrics {"StartTime": 1616442589.6808317, "EndTime": 1616442589.680843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5461741452494626, "count": 1, "min": 0.5461741452494626, "max": 0.5461741452494626}}} #metrics {"StartTime": 1616442589.680892, "EndTime": 1616442589.6809072, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5186055501302084, "count": 1, "min": 0.5186055501302084, "max": 0.5186055501302084}}} #metrics {"StartTime": 1616442589.6809738, "EndTime": 1616442589.6809938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5458460005502852, "count": 1, "min": 0.5458460005502852, "max": 0.5458460005502852}}} #metrics {"StartTime": 1616442589.6810563, "EndTime": 1616442589.681074, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4664489100219081, "count": 1, "min": 0.4664489100219081, "max": 0.4664489100219081}}} #metrics {"StartTime": 1616442589.6811304, "EndTime": 1616442589.6811457, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4932978392908813, "count": 1, "min": 0.4932978392908813, "max": 0.4932978392908813}}} #metrics {"StartTime": 1616442589.681202, "EndTime": 1616442589.681218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4770751226515997, "count": 1, "min": 0.4770751226515997, "max": 0.4770751226515997}}} #metrics {"StartTime": 1616442589.6812868, "EndTime": 1616442589.681305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4736656713738013, "count": 1, "min": 0.4736656713738013, "max": 0.4736656713738013}}} #metrics {"StartTime": 1616442589.6813614, "EndTime": 1616442589.6813817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6805952768477183, "count": 1, "min": 0.6805952768477183, "max": 0.6805952768477183}}} #metrics {"StartTime": 1616442589.6814373, "EndTime": 1616442589.6814542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.688040677832548, "count": 1, "min": 0.688040677832548, "max": 0.688040677832548}}} #metrics {"StartTime": 1616442589.681513, "EndTime": 1616442589.6815307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6930843131252067, "count": 1, "min": 0.6930843131252067, "max": 0.6930843131252067}}} #metrics {"StartTime": 1616442589.6815846, "EndTime": 1616442589.6816022, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6755401772796792, "count": 1, "min": 0.6755401772796792, "max": 0.6755401772796792}}} #metrics {"StartTime": 1616442589.6816707, "EndTime": 1616442589.681689, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7100211653129134, "count": 1, "min": 0.7100211653129134, "max": 0.7100211653129134}}} #metrics {"StartTime": 1616442589.6817472, "EndTime": 1616442589.6817641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6597981124958664, "count": 1, "min": 0.6597981124958664, "max": 0.6597981124958664}}} #metrics {"StartTime": 1616442589.6818197, "EndTime": 1616442589.681837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6738251781968213, "count": 1, "min": 0.6738251781968213, "max": 0.6738251781968213}}} #metrics {"StartTime": 1616442589.6818936, "EndTime": 1616442589.6819088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7125053607597553, "count": 1, "min": 0.7125053607597553, "max": 0.7125053607597553}}} [03/22/2021 19:49:49 INFO 140389653051200] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.5474355384786292 [2021-03-22 19:49:49.827] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 32, "duration": 124, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442589.9584968, "EndTime": 1616442589.9585683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5544464111328125, "count": 1, "min": 0.5544464111328125, "max": 0.5544464111328125}}} #metrics {"StartTime": 1616442589.9586608, "EndTime": 1616442589.9586763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5837454544870477, "count": 1, "min": 0.5837454544870477, "max": 0.5837454544870477}}} #metrics {"StartTime": 1616442589.958742, "EndTime": 1616442589.9587555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5719613727770354, "count": 1, "min": 0.5719613727770354, "max": 0.5719613727770354}}} #metrics {"StartTime": 1616442589.9588006, "EndTime": 1616442589.9588172, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5191080996864721, "count": 1, "min": 0.5191080996864721, "max": 0.5191080996864721}}} #metrics {"StartTime": 1616442589.958876, "EndTime": 1616442589.9588912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24736141405607526, "count": 1, "min": 0.24736141405607526, "max": 0.24736141405607526}}} #metrics {"StartTime": 1616442589.9589453, "EndTime": 1616442589.95896, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2530404341848273, "count": 1, "min": 0.2530404341848273, "max": 0.2530404341848273}}} #metrics {"StartTime": 1616442589.959015, "EndTime": 1616442589.9590347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24248344019839638, "count": 1, "min": 0.24248344019839638, "max": 0.24248344019839638}}} #metrics {"StartTime": 1616442589.9590874, "EndTime": 1616442589.9591055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24150089464689556, "count": 1, "min": 0.24150089464689556, "max": 0.24150089464689556}}} #metrics {"StartTime": 1616442589.9591632, "EndTime": 1616442589.9591799, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5405255769428454, "count": 1, "min": 0.5405255769428454, "max": 0.5405255769428454}}} #metrics {"StartTime": 1616442589.9592342, "EndTime": 1616442589.9592495, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5082639995374177, "count": 1, "min": 0.5082639995374177, "max": 0.5082639995374177}}} #metrics {"StartTime": 1616442589.9593058, "EndTime": 1616442589.9593225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5998957985325863, "count": 1, "min": 0.5998957985325863, "max": 0.5998957985325863}}} #metrics {"StartTime": 1616442589.9593766, "EndTime": 1616442589.959395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.549266855340255, "count": 1, "min": 0.549266855340255, "max": 0.549266855340255}}} #metrics {"StartTime": 1616442589.9594548, "EndTime": 1616442589.9594755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24785708377235813, "count": 1, "min": 0.24785708377235813, "max": 0.24785708377235813}}} #metrics {"StartTime": 1616442589.9595304, "EndTime": 1616442589.9595482, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24472732543945314, "count": 1, "min": 0.24472732543945314, "max": 0.24472732543945314}}} #metrics {"StartTime": 1616442589.959601, "EndTime": 1616442589.9596183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24921858938116775, "count": 1, "min": 0.24921858938116775, "max": 0.24921858938116775}}} #metrics {"StartTime": 1616442589.9596925, "EndTime": 1616442589.9597116, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24383291947214228, "count": 1, "min": 0.24383291947214228, "max": 0.24383291947214228}}} #metrics {"StartTime": 1616442589.9597785, "EndTime": 1616442589.9597964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5279477571186266, "count": 1, "min": 0.5279477571186266, "max": 0.5279477571186266}}} #metrics {"StartTime": 1616442589.9598587, "EndTime": 1616442589.9598753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5483463086579975, "count": 1, "min": 0.5483463086579975, "max": 0.5483463086579975}}} #metrics {"StartTime": 1616442589.959941, "EndTime": 1616442589.9599564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5203881514699835, "count": 1, "min": 0.5203881514699835, "max": 0.5203881514699835}}} #metrics {"StartTime": 1616442589.9600136, "EndTime": 1616442589.9600317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.542160355417352, "count": 1, "min": 0.542160355417352, "max": 0.542160355417352}}} #metrics {"StartTime": 1616442589.960088, "EndTime": 1616442589.960106, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.517021339818051, "count": 1, "min": 0.517021339818051, "max": 0.517021339818051}}} #metrics {"StartTime": 1616442589.9601612, "EndTime": 1616442589.960177, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5453771089252673, "count": 1, "min": 0.5453771089252673, "max": 0.5453771089252673}}} #metrics {"StartTime": 1616442589.960237, "EndTime": 1616442589.9602544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5109607094212583, "count": 1, "min": 0.5109607094212583, "max": 0.5109607094212583}}} #metrics {"StartTime": 1616442589.9603114, "EndTime": 1616442589.9603295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5241284420615748, "count": 1, "min": 0.5241284420615748, "max": 0.5241284420615748}}} #metrics {"StartTime": 1616442589.9603624, "EndTime": 1616442589.9603717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6819623445209704, "count": 1, "min": 0.6819623445209704, "max": 0.6819623445209704}}} #metrics {"StartTime": 1616442589.9604332, "EndTime": 1616442589.9604516, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6806513736122533, "count": 1, "min": 0.6806513736122533, "max": 0.6806513736122533}}} #metrics {"StartTime": 1616442589.9605017, "EndTime": 1616442589.960514, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6949761641652961, "count": 1, "min": 0.6949761641652961, "max": 0.6949761641652961}}} #metrics {"StartTime": 1616442589.9605434, "EndTime": 1616442589.9605515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6784525017989309, "count": 1, "min": 0.6784525017989309, "max": 0.6784525017989309}}} #metrics {"StartTime": 1616442589.9605865, "EndTime": 1616442589.9606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6805008737664474, "count": 1, "min": 0.6805008737664474, "max": 0.6805008737664474}}} #metrics {"StartTime": 1616442589.960651, "EndTime": 1616442589.9606645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6561249180843955, "count": 1, "min": 0.6561249180843955, "max": 0.6561249180843955}}} #metrics {"StartTime": 1616442589.9607193, "EndTime": 1616442589.960739, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6769123278166118, "count": 1, "min": 0.6769123278166118, "max": 0.6769123278166118}}} #metrics {"StartTime": 1616442589.9607902, "EndTime": 1616442589.9608061, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6943966514185855, "count": 1, "min": 0.6943966514185855, "max": 0.6943966514185855}}} [03/22/2021 19:49:49 INFO 140389653051200] #quality_metric: host=algo-1, epoch=10, validation binary_classification_cross_entropy_objective <loss>=0.5544464111328125 [03/22/2021 19:49:49 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:49 INFO 140389653051200] Epoch 10: Loss improved. Updating best model [03/22/2021 19:49:49 INFO 140389653051200] Saving model for epoch: 10 [03/22/2021 19:49:49 INFO 140389653051200] Saved checkpoint to "/tmp/tmpfn578042/mx-mod-0000.params" [03/22/2021 19:49:49 INFO 140389653051200] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs #metrics {"StartTime": 1616442589.6362987, "EndTime": 1616442589.9687428, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 9828.0, "count": 1, "min": 9828, "max": 9828}, "Total Batches Seen": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:49 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2272.994915517885 records/second [2021-03-22 19:49:50.012] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 26, "duration": 43, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442590.0126789, "EndTime": 1616442590.0127914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5354195246620784, "count": 1, "min": 0.5354195246620784, "max": 0.5354195246620784}}} #metrics {"StartTime": 1616442590.0129013, "EndTime": 1616442590.0129251, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5658068783068783, "count": 1, "min": 0.5658068783068783, "max": 0.5658068783068783}}} #metrics {"StartTime": 1616442590.012992, "EndTime": 1616442590.0130126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5576460903914517, "count": 1, "min": 0.5576460903914517, "max": 0.5576460903914517}}} #metrics {"StartTime": 1616442590.0130663, "EndTime": 1616442590.013085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5111849749529803, "count": 1, "min": 0.5111849749529803, "max": 0.5111849749529803}}} #metrics {"StartTime": 1616442590.0131493, "EndTime": 1616442590.0131664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2144351737209098, "count": 1, "min": 0.2144351737209098, "max": 0.2144351737209098}}} #metrics {"StartTime": 1616442590.0132182, "EndTime": 1616442590.0132349, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21588871466419685, "count": 1, "min": 0.21588871466419685, "max": 0.21588871466419685}}} #metrics {"StartTime": 1616442590.013298, "EndTime": 1616442590.0133288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21757216680617558, "count": 1, "min": 0.21757216680617558, "max": 0.21757216680617558}}} #metrics {"StartTime": 1616442590.0133832, "EndTime": 1616442590.0134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21171731292886078, "count": 1, "min": 0.21171731292886078, "max": 0.21171731292886078}}} #metrics {"StartTime": 1616442590.0134559, "EndTime": 1616442590.013474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.533349213776765, "count": 1, "min": 0.533349213776765, "max": 0.533349213776765}}} #metrics {"StartTime": 1616442590.0135295, "EndTime": 1616442590.013547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5029455114293981, "count": 1, "min": 0.5029455114293981, "max": 0.5029455114293981}}} #metrics {"StartTime": 1616442590.0136023, "EndTime": 1616442590.0136225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5833696234163153, "count": 1, "min": 0.5833696234163153, "max": 0.5833696234163153}}} #metrics {"StartTime": 1616442590.0136764, "EndTime": 1616442590.0136955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5371188209170387, "count": 1, "min": 0.5371188209170387, "max": 0.5371188209170387}}} #metrics {"StartTime": 1616442590.0137618, "EndTime": 1616442590.013776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21490058697089948, "count": 1, "min": 0.21490058697089948, "max": 0.21490058697089948}}} #metrics {"StartTime": 1616442590.013893, "EndTime": 1616442590.0139062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20446081010122147, "count": 1, "min": 0.20446081010122147, "max": 0.20446081010122147}}} #metrics {"StartTime": 1616442590.0139894, "EndTime": 1616442590.0140083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.22225225539434523, "count": 1, "min": 0.22225225539434523, "max": 0.22225225539434523}}} #metrics {"StartTime": 1616442590.0140672, "EndTime": 1616442590.0140843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20878911901403358, "count": 1, "min": 0.20878911901403358, "max": 0.20878911901403358}}} #metrics {"StartTime": 1616442590.0141504, "EndTime": 1616442590.0141683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5176344775648974, "count": 1, "min": 0.5176344775648974, "max": 0.5176344775648974}}} #metrics {"StartTime": 1616442590.0142238, "EndTime": 1616442590.0142412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5364368983677456, "count": 1, "min": 0.5364368983677456, "max": 0.5364368983677456}}} #metrics {"StartTime": 1616442590.0143, "EndTime": 1616442590.0143178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.509652435464203, "count": 1, "min": 0.509652435464203, "max": 0.509652435464203}}} #metrics {"StartTime": 1616442590.0143807, "EndTime": 1616442590.0143998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5357816988828952, "count": 1, "min": 0.5357816988828952, "max": 0.5357816988828952}}} #metrics {"StartTime": 1616442590.0144658, "EndTime": 1616442590.0144858, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4977774241613963, "count": 1, "min": 0.4977774241613963, "max": 0.4977774241613963}}} #metrics {"StartTime": 1616442590.0145435, "EndTime": 1616442590.0145605, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5197478198500537, "count": 1, "min": 0.5197478198500537, "max": 0.5197478198500537}}} #metrics {"StartTime": 1616442590.0146174, "EndTime": 1616442590.014636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.492354983375186, "count": 1, "min": 0.492354983375186, "max": 0.492354983375186}}} #metrics {"StartTime": 1616442590.014695, "EndTime": 1616442590.0147116, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5012345894303902, "count": 1, "min": 0.5012345894303902, "max": 0.5012345894303902}}} #metrics {"StartTime": 1616442590.0147765, "EndTime": 1616442590.01479, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6819876211660879, "count": 1, "min": 0.6819876211660879, "max": 0.6819876211660879}}} #metrics {"StartTime": 1616442590.0148542, "EndTime": 1616442590.0148726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6814826279090195, "count": 1, "min": 0.6814826279090195, "max": 0.6814826279090195}}} #metrics {"StartTime": 1616442590.0149422, "EndTime": 1616442590.0149627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6929553803943452, "count": 1, "min": 0.6929553803943452, "max": 0.6929553803943452}}} #metrics {"StartTime": 1616442590.015034, "EndTime": 1616442590.0150547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6794560346653853, "count": 1, "min": 0.6794560346653853, "max": 0.6794560346653853}}} #metrics {"StartTime": 1616442590.0151105, "EndTime": 1616442590.0151255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6735961348922165, "count": 1, "min": 0.6735961348922165, "max": 0.6735961348922165}}} #metrics {"StartTime": 1616442590.015192, "EndTime": 1616442590.0152137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6500249792028356, "count": 1, "min": 0.6500249792028356, "max": 0.6500249792028356}}} #metrics {"StartTime": 1616442590.0152705, "EndTime": 1616442590.0152853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6706582124901828, "count": 1, "min": 0.6706582124901828, "max": 0.6706582124901828}}} #metrics {"StartTime": 1616442590.0153408, "EndTime": 1616442590.0153587, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6919689683056383, "count": 1, "min": 0.6919689683056383, "max": 0.6919689683056383}}} [03/22/2021 19:49:50 INFO 140389653051200] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.5354195246620784 [2021-03-22 19:49:50.153] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 35, "duration": 115, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442590.305865, "EndTime": 1616442590.3059695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5433506212736431, "count": 1, "min": 0.5433506212736431, "max": 0.5433506212736431}}} #metrics {"StartTime": 1616442590.3060617, "EndTime": 1616442590.306078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5708235088147615, "count": 1, "min": 0.5708235088147615, "max": 0.5708235088147615}}} #metrics {"StartTime": 1616442590.3061223, "EndTime": 1616442590.3061383, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5595861334549753, "count": 1, "min": 0.5595861334549753, "max": 0.5595861334549753}}} #metrics {"StartTime": 1616442590.3062022, "EndTime": 1616442590.306216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5093653628700658, "count": 1, "min": 0.5093653628700658, "max": 0.5093653628700658}}} #metrics {"StartTime": 1616442590.306269, "EndTime": 1616442590.3062873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24490408646432976, "count": 1, "min": 0.24490408646432976, "max": 0.24490408646432976}}} #metrics {"StartTime": 1616442590.306347, "EndTime": 1616442590.3063643, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2514195291619552, "count": 1, "min": 0.2514195291619552, "max": 0.2514195291619552}}} #metrics {"StartTime": 1616442590.3064206, "EndTime": 1616442590.306437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23998774478310034, "count": 1, "min": 0.23998774478310034, "max": 0.23998774478310034}}} #metrics {"StartTime": 1616442590.3064873, "EndTime": 1616442590.3064954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2386540463096217, "count": 1, "min": 0.2386540463096217, "max": 0.2386540463096217}}} #metrics {"StartTime": 1616442590.3065238, "EndTime": 1616442590.3065374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5306144312808388, "count": 1, "min": 0.5306144312808388, "max": 0.5306144312808388}}} #metrics {"StartTime": 1616442590.3065848, "EndTime": 1616442590.3066015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4991449456465872, "count": 1, "min": 0.4991449456465872, "max": 0.4991449456465872}}} #metrics {"StartTime": 1616442590.3066444, "EndTime": 1616442590.3066578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5867910284745066, "count": 1, "min": 0.5867910284745066, "max": 0.5867910284745066}}} #metrics {"StartTime": 1616442590.3067024, "EndTime": 1616442590.3067179, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5378265782406456, "count": 1, "min": 0.5378265782406456, "max": 0.5378265782406456}}} #metrics {"StartTime": 1616442590.306769, "EndTime": 1616442590.306785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24696876124331826, "count": 1, "min": 0.24696876124331826, "max": 0.24696876124331826}}} #metrics {"StartTime": 1616442590.3068256, "EndTime": 1616442590.306834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24252275165758636, "count": 1, "min": 0.24252275165758636, "max": 0.24252275165758636}}} #metrics {"StartTime": 1616442590.3068645, "EndTime": 1616442590.3068726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2472190254612973, "count": 1, "min": 0.2472190254612973, "max": 0.2472190254612973}}} #metrics {"StartTime": 1616442590.3068962, "EndTime": 1616442590.3069038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24230105751439146, "count": 1, "min": 0.24230105751439146, "max": 0.24230105751439146}}} #metrics {"StartTime": 1616442590.306929, "EndTime": 1616442590.3069375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5197746276855468, "count": 1, "min": 0.5197746276855468, "max": 0.5197746276855468}}} #metrics {"StartTime": 1616442590.3069842, "EndTime": 1616442590.307003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5388694763183594, "count": 1, "min": 0.5388694763183594, "max": 0.5388694763183594}}} #metrics {"StartTime": 1616442590.3070667, "EndTime": 1616442590.3070848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5127845764160156, "count": 1, "min": 0.5127845764160156, "max": 0.5127845764160156}}} #metrics {"StartTime": 1616442590.3071437, "EndTime": 1616442590.3071609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.534084681460732, "count": 1, "min": 0.534084681460732, "max": 0.534084681460732}}} #metrics {"StartTime": 1616442590.30722, "EndTime": 1616442590.307236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5218528346011513, "count": 1, "min": 0.5218528346011513, "max": 0.5218528346011513}}} #metrics {"StartTime": 1616442590.3072953, "EndTime": 1616442590.30731, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.535538040964227, "count": 1, "min": 0.535538040964227, "max": 0.535538040964227}}} #metrics {"StartTime": 1616442590.3073785, "EndTime": 1616442590.3073978, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5024408039293791, "count": 1, "min": 0.5024408039293791, "max": 0.5024408039293791}}} #metrics {"StartTime": 1616442590.3074691, "EndTime": 1616442590.3074872, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5256409896047491, "count": 1, "min": 0.5256409896047491, "max": 0.5256409896047491}}} #metrics {"StartTime": 1616442590.3075523, "EndTime": 1616442590.3075688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6836873104697779, "count": 1, "min": 0.6836873104697779, "max": 0.6836873104697779}}} #metrics {"StartTime": 1616442590.3076391, "EndTime": 1616442590.3076544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6753285458213405, "count": 1, "min": 0.6753285458213405, "max": 0.6753285458213405}}} #metrics {"StartTime": 1616442590.3077226, "EndTime": 1616442590.3077414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6948770623458059, "count": 1, "min": 0.6948770623458059, "max": 0.6948770623458059}}} #metrics {"StartTime": 1616442590.3078072, "EndTime": 1616442590.3078253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6825551886307566, "count": 1, "min": 0.6825551886307566, "max": 0.6825551886307566}}} #metrics {"StartTime": 1616442590.3078775, "EndTime": 1616442590.3078897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6620299891421669, "count": 1, "min": 0.6620299891421669, "max": 0.6620299891421669}}} #metrics {"StartTime": 1616442590.3079212, "EndTime": 1616442590.3079288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6646383586682771, "count": 1, "min": 0.6646383586682771, "max": 0.6646383586682771}}} #metrics {"StartTime": 1616442590.3079789, "EndTime": 1616442590.3079972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6872295178865132, "count": 1, "min": 0.6872295178865132, "max": 0.6872295178865132}}} #metrics {"StartTime": 1616442590.308061, "EndTime": 1616442590.3080773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6820154290450247, "count": 1, "min": 0.6820154290450247, "max": 0.6820154290450247}}} [03/22/2021 19:49:50 INFO 140389653051200] #quality_metric: host=algo-1, epoch=11, validation binary_classification_cross_entropy_objective <loss>=0.5433506212736431 [03/22/2021 19:49:50 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:50 INFO 140389653051200] Epoch 11: Loss improved. Updating best model [03/22/2021 19:49:50 INFO 140389653051200] Saving model for epoch: 11 [03/22/2021 19:49:50 INFO 140389653051200] Saved checkpoint to "/tmp/tmp4pebuerd/mx-mod-0000.params" [03/22/2021 19:49:50 INFO 140389653051200] #progress_metric: host=algo-1, completed 80.0 % of epochs #metrics {"StartTime": 1616442589.9690716, "EndTime": 1616442590.3160453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 10584.0, "count": 1, "min": 10584, "max": 10584}, "Total Batches Seen": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:50 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2177.8431035063004 records/second [2021-03-22 19:49:50.359] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 28, "duration": 42, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442590.3592207, "EndTime": 1616442590.3593166, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5241347217055224, "count": 1, "min": 0.5241347217055224, "max": 0.5241347217055224}}} #metrics {"StartTime": 1616442590.3594258, "EndTime": 1616442590.3594441, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5532769904565559, "count": 1, "min": 0.5532769904565559, "max": 0.5532769904565559}}} #metrics {"StartTime": 1616442590.3594913, "EndTime": 1616442590.3595026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5447853532417741, "count": 1, "min": 0.5447853532417741, "max": 0.5447853532417741}}} #metrics {"StartTime": 1616442590.359547, "EndTime": 1616442590.3595555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5010495059704655, "count": 1, "min": 0.5010495059704655, "max": 0.5010495059704655}}} #metrics {"StartTime": 1616442590.359614, "EndTime": 1616442590.3596246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2109592175357556, "count": 1, "min": 0.2109592175357556, "max": 0.2109592175357556}}} #metrics {"StartTime": 1616442590.3596737, "EndTime": 1616442590.359687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21205351087782118, "count": 1, "min": 0.21205351087782118, "max": 0.21205351087782118}}} #metrics {"StartTime": 1616442590.3597286, "EndTime": 1616442590.3597407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21353121157045718, "count": 1, "min": 0.21353121157045718, "max": 0.21353121157045718}}} #metrics {"StartTime": 1616442590.3597822, "EndTime": 1616442590.3597937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20773359833571015, "count": 1, "min": 0.20773359833571015, "max": 0.20773359833571015}}} #metrics {"StartTime": 1616442590.3598337, "EndTime": 1616442590.3598459, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5228239594313203, "count": 1, "min": 0.5228239594313203, "max": 0.5228239594313203}}} #metrics {"StartTime": 1616442590.359893, "EndTime": 1616442590.3599062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.49334854045242227, "count": 1, "min": 0.49334854045242227, "max": 0.49334854045242227}}} #metrics {"StartTime": 1616442590.3599489, "EndTime": 1616442590.3599608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5705547433681589, "count": 1, "min": 0.5705547433681589, "max": 0.5705547433681589}}} #metrics {"StartTime": 1616442590.3600075, "EndTime": 1616442590.3600218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.526061769515749, "count": 1, "min": 0.526061769515749, "max": 0.526061769515749}}} #metrics {"StartTime": 1616442590.3600612, "EndTime": 1616442590.3600736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21009144455036788, "count": 1, "min": 0.21009144455036788, "max": 0.21009144455036788}}} #metrics {"StartTime": 1616442590.360128, "EndTime": 1616442590.3601437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20034099760509672, "count": 1, "min": 0.20034099760509672, "max": 0.20034099760509672}}} #metrics {"StartTime": 1616442590.3602006, "EndTime": 1616442590.36022, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21764095245845735, "count": 1, "min": 0.21764095245845735, "max": 0.21764095245845735}}} #metrics {"StartTime": 1616442590.3602736, "EndTime": 1616442590.3602912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20498235389669106, "count": 1, "min": 0.20498235389669106, "max": 0.20498235389669106}}} #metrics {"StartTime": 1616442590.3603437, "EndTime": 1616442590.3603616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5093815717747603, "count": 1, "min": 0.5093815717747603, "max": 0.5093815717747603}}} #metrics {"StartTime": 1616442590.3604262, "EndTime": 1616442590.3604448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5274487046337633, "count": 1, "min": 0.5274487046337633, "max": 0.5274487046337633}}} #metrics {"StartTime": 1616442590.360502, "EndTime": 1616442590.3605192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5014144251586268, "count": 1, "min": 0.5014144251586268, "max": 0.5014144251586268}}} #metrics {"StartTime": 1616442590.3605704, "EndTime": 1616442590.3605888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.52644695302166, "count": 1, "min": 0.52644695302166, "max": 0.52644695302166}}} #metrics {"StartTime": 1616442590.3606427, "EndTime": 1616442590.3606586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5029040139818949, "count": 1, "min": 0.5029040139818949, "max": 0.5029040139818949}}} #metrics {"StartTime": 1616442590.3607132, "EndTime": 1616442590.3607306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5107040808945106, "count": 1, "min": 0.5107040808945106, "max": 0.5107040808945106}}} #metrics {"StartTime": 1616442590.3607843, "EndTime": 1616442590.3608024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4864645256567254, "count": 1, "min": 0.4864645256567254, "max": 0.4864645256567254}}} #metrics {"StartTime": 1616442590.3608558, "EndTime": 1616442590.360876, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5008015304646164, "count": 1, "min": 0.5008015304646164, "max": 0.5008015304646164}}} #metrics {"StartTime": 1616442590.3609378, "EndTime": 1616442590.3609564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.683022796792328, "count": 1, "min": 0.683022796792328, "max": 0.683022796792328}}} #metrics {"StartTime": 1616442590.3610158, "EndTime": 1616442590.3610334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6758207290891617, "count": 1, "min": 0.6758207290891617, "max": 0.6758207290891617}}} #metrics {"StartTime": 1616442590.361094, "EndTime": 1616442590.361112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6922552522528108, "count": 1, "min": 0.6922552522528108, "max": 0.6922552522528108}}} #metrics {"StartTime": 1616442590.3611662, "EndTime": 1616442590.3611834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6830447565310847, "count": 1, "min": 0.6830447565310847, "max": 0.6830447565310847}}} #metrics {"StartTime": 1616442590.3612368, "EndTime": 1616442590.3612564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6537536136687748, "count": 1, "min": 0.6537536136687748, "max": 0.6537536136687748}}} #metrics {"StartTime": 1616442590.3613136, "EndTime": 1616442590.3613305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6634029408611318, "count": 1, "min": 0.6634029408611318, "max": 0.6634029408611318}}} #metrics {"StartTime": 1616442590.3613815, "EndTime": 1616442590.361402, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6827704212652943, "count": 1, "min": 0.6827704212652943, "max": 0.6827704212652943}}} #metrics {"StartTime": 1616442590.3614576, "EndTime": 1616442590.361475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6800267456700562, "count": 1, "min": 0.6800267456700562, "max": 0.6800267456700562}}} [03/22/2021 19:49:50 INFO 140389653051200] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.5241347217055224 [2021-03-22 19:49:50.497] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 38, "duration": 115, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442590.6497543, "EndTime": 1616442590.6498296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5328987121582032, "count": 1, "min": 0.5328987121582032, "max": 0.5328987121582032}}} #metrics {"StartTime": 1616442590.6499417, "EndTime": 1616442590.649959, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5586333826968545, "count": 1, "min": 0.5586333826968545, "max": 0.5586333826968545}}} #metrics {"StartTime": 1616442590.6500108, "EndTime": 1616442590.6500275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5478638498406662, "count": 1, "min": 0.5478638498406662, "max": 0.5478638498406662}}} #metrics {"StartTime": 1616442590.6500928, "EndTime": 1616442590.6501088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5002092863384046, "count": 1, "min": 0.5002092863384046, "max": 0.5002092863384046}}} #metrics {"StartTime": 1616442590.650173, "EndTime": 1616442590.6501915, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24025144075092517, "count": 1, "min": 0.24025144075092517, "max": 0.24025144075092517}}} #metrics {"StartTime": 1616442590.6502442, "EndTime": 1616442590.650259, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24734264173005757, "count": 1, "min": 0.24734264173005757, "max": 0.24734264173005757}}} #metrics {"StartTime": 1616442590.650318, "EndTime": 1616442590.6503332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2354408063386616, "count": 1, "min": 0.2354408063386616, "max": 0.2354408063386616}}} #metrics {"StartTime": 1616442590.6503892, "EndTime": 1616442590.6504047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2337965915077611, "count": 1, "min": 0.2337965915077611, "max": 0.2337965915077611}}} #metrics {"StartTime": 1616442590.6504583, "EndTime": 1616442590.650475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5212974146792763, "count": 1, "min": 0.5212974146792763, "max": 0.5212974146792763}}} #metrics {"StartTime": 1616442590.6505275, "EndTime": 1616442590.650545, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.49057119269120064, "count": 1, "min": 0.49057119269120064, "max": 0.49057119269120064}}} #metrics {"StartTime": 1616442590.6505957, "EndTime": 1616442590.6506083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.574400490208676, "count": 1, "min": 0.574400490208676, "max": 0.574400490208676}}} #metrics {"StartTime": 1616442590.650656, "EndTime": 1616442590.65067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5270491750616776, "count": 1, "min": 0.5270491750616776, "max": 0.5270491750616776}}} #metrics {"StartTime": 1616442590.6507177, "EndTime": 1616442590.6507323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24437374315763774, "count": 1, "min": 0.24437374315763774, "max": 0.24437374315763774}}} #metrics {"StartTime": 1616442590.650776, "EndTime": 1616442590.6507902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23774012515419407, "count": 1, "min": 0.23774012515419407, "max": 0.23774012515419407}}} #metrics {"StartTime": 1616442590.6508424, "EndTime": 1616442590.6508598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.243937843724301, "count": 1, "min": 0.243937843724301, "max": 0.243937843724301}}} #metrics {"StartTime": 1616442590.6509137, "EndTime": 1616442590.6509295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23832369352641858, "count": 1, "min": 0.23832369352641858, "max": 0.23832369352641858}}} #metrics {"StartTime": 1616442590.6509843, "EndTime": 1616442590.6510053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.512327736302426, "count": 1, "min": 0.512327736302426, "max": 0.512327736302426}}} #metrics {"StartTime": 1616442590.6510575, "EndTime": 1616442590.6510801, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5301511664139597, "count": 1, "min": 0.5301511664139597, "max": 0.5301511664139597}}} #metrics {"StartTime": 1616442590.6511304, "EndTime": 1616442590.6511464, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5057666176243832, "count": 1, "min": 0.5057666176243832, "max": 0.5057666176243832}}} #metrics {"StartTime": 1616442590.6511993, "EndTime": 1616442590.6512158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5265063637181332, "count": 1, "min": 0.5265063637181332, "max": 0.5265063637181332}}} #metrics {"StartTime": 1616442590.6512678, "EndTime": 1616442590.6512878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5027501959549753, "count": 1, "min": 0.5027501959549753, "max": 0.5027501959549753}}} #metrics {"StartTime": 1616442590.6513457, "EndTime": 1616442590.651363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5009446395070929, "count": 1, "min": 0.5009446395070929, "max": 0.5009446395070929}}} #metrics {"StartTime": 1616442590.6514187, "EndTime": 1616442590.6514344, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4840178238718133, "count": 1, "min": 0.4840178238718133, "max": 0.4840178238718133}}} #metrics {"StartTime": 1616442590.65149, "EndTime": 1616442590.6515043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5023147984554893, "count": 1, "min": 0.5023147984554893, "max": 0.5023147984554893}}} #metrics {"StartTime": 1616442590.6515613, "EndTime": 1616442590.651578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851143284847862, "count": 1, "min": 0.6851143284847862, "max": 0.6851143284847862}}} #metrics {"StartTime": 1616442590.651643, "EndTime": 1616442590.65166, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6710648386101974, "count": 1, "min": 0.6710648386101974, "max": 0.6710648386101974}}} #metrics {"StartTime": 1616442590.6517167, "EndTime": 1616442590.6517344, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6940783048930921, "count": 1, "min": 0.6940783048930921, "max": 0.6940783048930921}}} #metrics {"StartTime": 1616442590.6517808, "EndTime": 1616442590.6517954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.686202681692023, "count": 1, "min": 0.686202681692023, "max": 0.686202681692023}}} #metrics {"StartTime": 1616442590.6518512, "EndTime": 1616442590.651868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.667942970677426, "count": 1, "min": 0.667942970677426, "max": 0.667942970677426}}} #metrics {"StartTime": 1616442590.6519184, "EndTime": 1616442590.6519372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6955648321854441, "count": 1, "min": 0.6955648321854441, "max": 0.6955648321854441}}} #metrics {"StartTime": 1616442590.6519904, "EndTime": 1616442590.6520042, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7092622455797697, "count": 1, "min": 0.7092622455797697, "max": 0.7092622455797697}}} #metrics {"StartTime": 1616442590.652062, "EndTime": 1616442590.6520796, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843763652600741, "count": 1, "min": 0.6843763652600741, "max": 0.6843763652600741}}} [03/22/2021 19:49:50 INFO 140389653051200] #quality_metric: host=algo-1, epoch=12, validation binary_classification_cross_entropy_objective <loss>=0.5328987121582032 [03/22/2021 19:49:50 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:50 INFO 140389653051200] Epoch 12: Loss improved. Updating best model [03/22/2021 19:49:50 INFO 140389653051200] Saving model for epoch: 12 [03/22/2021 19:49:50 INFO 140389653051200] Saved checkpoint to "/tmp/tmpaa2q5pbm/mx-mod-0000.params" [03/22/2021 19:49:50 INFO 140389653051200] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs #metrics {"StartTime": 1616442590.3163602, "EndTime": 1616442590.6598368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 11340.0, "count": 1, "min": 11340, "max": 11340}, "Total Batches Seen": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:50 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=2200.1578005178976 records/second [2021-03-22 19:49:50.704] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 30, "duration": 44, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442590.7047338, "EndTime": 1616442590.7048357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5135323660714286, "count": 1, "min": 0.5135323660714286, "max": 0.5135323660714286}}} #metrics {"StartTime": 1616442590.704935, "EndTime": 1616442590.7049525, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5415273999410962, "count": 1, "min": 0.5415273999410962, "max": 0.5415273999410962}}} #metrics {"StartTime": 1616442590.705001, "EndTime": 1616442590.7050138, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5327094749168113, "count": 1, "min": 0.5327094749168113, "max": 0.5327094749168113}}} #metrics {"StartTime": 1616442590.7050653, "EndTime": 1616442590.7050781, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4915196252247644, "count": 1, "min": 0.4915196252247644, "max": 0.4915196252247644}}} #metrics {"StartTime": 1616442590.7051194, "EndTime": 1616442590.7051308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20586140950520834, "count": 1, "min": 0.20586140950520834, "max": 0.20586140950520834}}} #metrics {"StartTime": 1616442590.7051702, "EndTime": 1616442590.7051811, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2066153672637132, "count": 1, "min": 0.2066153672637132, "max": 0.2066153672637132}}} #metrics {"StartTime": 1616442590.7053514, "EndTime": 1616442590.7053685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2079663352360801, "count": 1, "min": 0.2079663352360801, "max": 0.2079663352360801}}} #metrics {"StartTime": 1616442590.7054129, "EndTime": 1616442590.7054245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20205369575944526, "count": 1, "min": 0.20205369575944526, "max": 0.20205369575944526}}} #metrics {"StartTime": 1616442590.7054636, "EndTime": 1616442590.7054746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5129170089802414, "count": 1, "min": 0.5129170089802414, "max": 0.5129170089802414}}} #metrics {"StartTime": 1616442590.7055416, "EndTime": 1616442590.7055542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4843365300900091, "count": 1, "min": 0.4843365300900091, "max": 0.4843365300900091}}} #metrics {"StartTime": 1616442590.7056038, "EndTime": 1616442590.705617, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5584973128384383, "count": 1, "min": 0.5584973128384383, "max": 0.5584973128384383}}} #metrics {"StartTime": 1616442590.705669, "EndTime": 1616442590.7056863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5156687580088459, "count": 1, "min": 0.5156687580088459, "max": 0.5156687580088459}}} #metrics {"StartTime": 1616442590.7057402, "EndTime": 1616442590.705785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2042014510543258, "count": 1, "min": 0.2042014510543258, "max": 0.2042014510543258}}} #metrics {"StartTime": 1616442590.7058437, "EndTime": 1616442590.7058616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19478142955315808, "count": 1, "min": 0.19478142955315808, "max": 0.19478142955315808}}} #metrics {"StartTime": 1616442590.7059379, "EndTime": 1616442590.7059593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.21186239252645503, "count": 1, "min": 0.21186239252645503, "max": 0.21186239252645503}}} #metrics {"StartTime": 1616442590.7060173, "EndTime": 1616442590.7060344, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1997310900814319, "count": 1, "min": 0.1997310900814319, "max": 0.1997310900814319}}} #metrics {"StartTime": 1616442590.706089, "EndTime": 1616442590.7061067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5018127279937583, "count": 1, "min": 0.5018127279937583, "max": 0.5018127279937583}}} #metrics {"StartTime": 1616442590.7061698, "EndTime": 1616442590.706188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5191490940316014, "count": 1, "min": 0.5191490940316014, "max": 0.5191490940316014}}} #metrics {"StartTime": 1616442590.7062407, "EndTime": 1616442590.7062578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.49385389701399224, "count": 1, "min": 0.49385389701399224, "max": 0.49385389701399224}}} #metrics {"StartTime": 1616442590.7063143, "EndTime": 1616442590.7063315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5178055939850984, "count": 1, "min": 0.5178055939850984, "max": 0.5178055939850984}}} #metrics {"StartTime": 1616442590.706399, "EndTime": 1616442590.7064164, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4872438138124173, "count": 1, "min": 0.4872438138124173, "max": 0.4872438138124173}}} #metrics {"StartTime": 1616442590.7064703, "EndTime": 1616442590.7064862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4808067039207176, "count": 1, "min": 0.4808067039207176, "max": 0.4808067039207176}}} #metrics {"StartTime": 1616442590.7065482, "EndTime": 1616442590.7065675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.47173700887690145, "count": 1, "min": 0.47173700887690145, "max": 0.47173700887690145}}} #metrics {"StartTime": 1616442590.706625, "EndTime": 1616442590.706642, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.48065556924809855, "count": 1, "min": 0.48065556924809855, "max": 0.48065556924809855}}} #metrics {"StartTime": 1616442590.7066963, "EndTime": 1616442590.7067134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6838021253151868, "count": 1, "min": 0.6838021253151868, "max": 0.6838021253151868}}} #metrics {"StartTime": 1616442590.7067606, "EndTime": 1616442590.706776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6712368354595527, "count": 1, "min": 0.6712368354595527, "max": 0.6712368354595527}}} #metrics {"StartTime": 1616442590.706834, "EndTime": 1616442590.7068515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6909988645523314, "count": 1, "min": 0.6909988645523314, "max": 0.6909988645523314}}} #metrics {"StartTime": 1616442590.706901, "EndTime": 1616442590.7069173, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686226658089451, "count": 1, "min": 0.686226658089451, "max": 0.686226658089451}}} #metrics {"StartTime": 1616442590.7069743, "EndTime": 1616442590.706991, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6613984688249215, "count": 1, "min": 0.6613984688249215, "max": 0.6613984688249215}}} #metrics {"StartTime": 1616442590.707049, "EndTime": 1616442590.7070658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6986377050006201, "count": 1, "min": 0.6986377050006201, "max": 0.6986377050006201}}} #metrics {"StartTime": 1616442590.7071137, "EndTime": 1616442590.7071304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.70924966802042, "count": 1, "min": 0.70924966802042, "max": 0.70924966802042}}} #metrics {"StartTime": 1616442590.7071772, "EndTime": 1616442590.7071943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851248766379382, "count": 1, "min": 0.6851248766379382, "max": 0.6851248766379382}}} [03/22/2021 19:49:50 INFO 140389653051200] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.5135323660714286 [2021-03-22 19:49:50.861] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 41, "duration": 129, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442591.0738206, "EndTime": 1616442591.0739057, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5230627361096833, "count": 1, "min": 0.5230627361096833, "max": 0.5230627361096833}}} #metrics {"StartTime": 1616442591.0740376, "EndTime": 1616442591.0740542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5471762406198601, "count": 1, "min": 0.5471762406198601, "max": 0.5471762406198601}}} #metrics {"StartTime": 1616442591.0741048, "EndTime": 1616442591.074122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5367832384611431, "count": 1, "min": 0.5367832384611431, "max": 0.5367832384611431}}} #metrics {"StartTime": 1616442591.0741715, "EndTime": 1616442591.074188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4916316785310444, "count": 1, "min": 0.4916316785310444, "max": 0.4916316785310444}}} #metrics {"StartTime": 1616442591.0742426, "EndTime": 1616442591.0742602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23405641254625822, "count": 1, "min": 0.23405641254625822, "max": 0.23405641254625822}}} #metrics {"StartTime": 1616442591.0742962, "EndTime": 1616442591.0743055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24139141283537213, "count": 1, "min": 0.24139141283537213, "max": 0.24139141283537213}}} #metrics {"StartTime": 1616442591.0743337, "EndTime": 1616442591.0743408, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22956579107987254, "count": 1, "min": 0.22956579107987254, "max": 0.22956579107987254}}} #metrics {"StartTime": 1616442591.0743856, "EndTime": 1616442591.0744016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22772584212453742, "count": 1, "min": 0.22772584212453742, "max": 0.22772584212453742}}} #metrics {"StartTime": 1616442591.0744543, "EndTime": 1616442591.0744703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5125532049881785, "count": 1, "min": 0.5125532049881785, "max": 0.5125532049881785}}} #metrics {"StartTime": 1616442591.0745306, "EndTime": 1616442591.074549, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.48252443012438323, "count": 1, "min": 0.48252443012438323, "max": 0.48252443012438323}}} #metrics {"StartTime": 1616442591.0746038, "EndTime": 1616442591.074621, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5627246655915913, "count": 1, "min": 0.5627246655915913, "max": 0.5627246655915913}}} #metrics {"StartTime": 1616442591.074679, "EndTime": 1616442591.0746956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5169323971396999, "count": 1, "min": 0.5169323971396999, "max": 0.5169323971396999}}} #metrics {"StartTime": 1616442591.074751, "EndTime": 1616442591.0747683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.24079778570877877, "count": 1, "min": 0.24079778570877877, "max": 0.24079778570877877}}} #metrics {"StartTime": 1616442591.0748239, "EndTime": 1616442591.0748405, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23137441936292147, "count": 1, "min": 0.23137441936292147, "max": 0.23137441936292147}}} #metrics {"StartTime": 1616442591.0748956, "EndTime": 1616442591.074914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23990725467079563, "count": 1, "min": 0.23990725467079563, "max": 0.23990725467079563}}} #metrics {"StartTime": 1616442591.074969, "EndTime": 1616442591.0749857, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23268051147460939, "count": 1, "min": 0.23268051147460939, "max": 0.23268051147460939}}} #metrics {"StartTime": 1616442591.0750518, "EndTime": 1616442591.0750687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5055940326891447, "count": 1, "min": 0.5055940326891447, "max": 0.5055940326891447}}} #metrics {"StartTime": 1616442591.0751278, "EndTime": 1616442591.0751443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5221698961759869, "count": 1, "min": 0.5221698961759869, "max": 0.5221698961759869}}} #metrics {"StartTime": 1616442591.0752296, "EndTime": 1616442591.0752482, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4993300588507401, "count": 1, "min": 0.4993300588507401, "max": 0.4993300588507401}}} #metrics {"StartTime": 1616442591.075308, "EndTime": 1616442591.0753253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5194124723735608, "count": 1, "min": 0.5194124723735608, "max": 0.5194124723735608}}} #metrics {"StartTime": 1616442591.0753803, "EndTime": 1616442591.0753982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.47907325343081825, "count": 1, "min": 0.47907325343081825, "max": 0.47907325343081825}}} #metrics {"StartTime": 1616442591.075454, "EndTime": 1616442591.0754724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4666703876696135, "count": 1, "min": 0.4666703876696135, "max": 0.4666703876696135}}} #metrics {"StartTime": 1616442591.0755265, "EndTime": 1616442591.0755458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.47031266061883226, "count": 1, "min": 0.47031266061883226, "max": 0.47031266061883226}}} #metrics {"StartTime": 1616442591.0756001, "EndTime": 1616442591.0756176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.47450240285773027, "count": 1, "min": 0.47450240285773027, "max": 0.47450240285773027}}} #metrics {"StartTime": 1616442591.0756714, "EndTime": 1616442591.0756905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6863135889956825, "count": 1, "min": 0.6863135889956825, "max": 0.6863135889956825}}} #metrics {"StartTime": 1616442591.0757465, "EndTime": 1616442591.075765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6679288362201892, "count": 1, "min": 0.6679288362201892, "max": 0.6679288362201892}}} #metrics {"StartTime": 1616442591.0758247, "EndTime": 1616442591.0758424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6927230031866777, "count": 1, "min": 0.6927230031866777, "max": 0.6927230031866777}}} #metrics {"StartTime": 1616442591.075897, "EndTime": 1616442591.0759144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6893236662212171, "count": 1, "min": 0.6893236662212171, "max": 0.6893236662212171}}} #metrics {"StartTime": 1616442591.0759668, "EndTime": 1616442591.0759845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6892499421772204, "count": 1, "min": 0.6892499421772204, "max": 0.6892499421772204}}} #metrics {"StartTime": 1616442591.0760393, "EndTime": 1616442591.0760589, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7285209254214638, "count": 1, "min": 0.7285209254214638, "max": 0.7285209254214638}}} #metrics {"StartTime": 1616442591.0761187, "EndTime": 1616442591.0761373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7283209549753289, "count": 1, "min": 0.7283209549753289, "max": 0.7283209549753289}}} #metrics {"StartTime": 1616442591.076192, "EndTime": 1616442591.0762103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6945352654708059, "count": 1, "min": 0.6945352654708059, "max": 0.6945352654708059}}} [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, epoch=13, validation binary_classification_cross_entropy_objective <loss>=0.5230627361096833 [03/22/2021 19:49:51 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:51 INFO 140389653051200] Epoch 13: Loss improved. Updating best model [03/22/2021 19:49:51 INFO 140389653051200] Saving model for epoch: 13 [03/22/2021 19:49:51 INFO 140389653051200] Saved checkpoint to "/tmp/tmpwh42lkpi/mx-mod-0000.params" [03/22/2021 19:49:51 INFO 140389653051200] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs #metrics {"StartTime": 1616442590.6601715, "EndTime": 1616442591.084864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12096.0, "count": 1, "min": 12096, "max": 12096}, "Total Batches Seen": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:51 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1779.5295195165534 records/second [2021-03-22 19:49:51.136] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 32, "duration": 51, "num_examples": 1, "num_bytes": 114912} #metrics {"StartTime": 1616442591.136973, "EndTime": 1616442591.1370866, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5035481124958664, "count": 1, "min": 0.5035481124958664, "max": 0.5035481124958664}}} #metrics {"StartTime": 1616442591.1371999, "EndTime": 1616442591.137223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5304893614753844, "count": 1, "min": 0.5304893614753844, "max": 0.5304893614753844}}} #metrics {"StartTime": 1616442591.1372957, "EndTime": 1616442591.1373155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5213568147528108, "count": 1, "min": 0.5213568147528108, "max": 0.5213568147528108}}} #metrics {"StartTime": 1616442591.1373746, "EndTime": 1616442591.1373923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4825359929806341, "count": 1, "min": 0.4825359929806341, "max": 0.4825359929806341}}} #metrics {"StartTime": 1616442591.1374488, "EndTime": 1616442591.137467, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19968616142474785, "count": 1, "min": 0.19968616142474785, "max": 0.19968616142474785}}} #metrics {"StartTime": 1616442591.1375248, "EndTime": 1616442591.1375425, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20014461133845898, "count": 1, "min": 0.20014461133845898, "max": 0.20014461133845898}}} #metrics {"StartTime": 1616442591.1375978, "EndTime": 1616442591.1376164, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2014934398509838, "count": 1, "min": 0.2014934398509838, "max": 0.2014934398509838}}} #metrics {"StartTime": 1616442591.137671, "EndTime": 1616442591.1376886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19542017941752438, "count": 1, "min": 0.19542017941752438, "max": 0.19542017941752438}}} #metrics {"StartTime": 1616442591.1377456, "EndTime": 1616442591.1377633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5035683768136161, "count": 1, "min": 0.5035683768136161, "max": 0.5035683768136161}}} #metrics {"StartTime": 1616442591.1378202, "EndTime": 1616442591.137839, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4758527644727596, "count": 1, "min": 0.4758527644727596, "max": 0.4758527644727596}}} #metrics {"StartTime": 1616442591.1378953, "EndTime": 1616442591.137914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5471302819630456, "count": 1, "min": 0.5471302819630456, "max": 0.5471302819630456}}} #metrics {"StartTime": 1616442591.1380134, "EndTime": 1616442591.1380334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5058745530547288, "count": 1, "min": 0.5058745530547288, "max": 0.5058745530547288}}} #metrics {"StartTime": 1616442591.1380897, "EndTime": 1616442591.1381083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19796409808769427, "count": 1, "min": 0.19796409808769427, "max": 0.19796409808769427}}} #metrics {"StartTime": 1616442591.1381655, "EndTime": 1616442591.1381848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18857852996341765, "count": 1, "min": 0.18857852996341765, "max": 0.18857852996341765}}} #metrics {"StartTime": 1616442591.138241, "EndTime": 1616442591.1382587, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.20563163959160052, "count": 1, "min": 0.20563163959160052, "max": 0.20563163959160052}}} #metrics {"StartTime": 1616442591.1383142, "EndTime": 1616442591.1383321, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1937017491254857, "count": 1, "min": 0.1937017491254857, "max": 0.1937017491254857}}} #metrics {"StartTime": 1616442591.1383865, "EndTime": 1616442591.1384046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.49486707253430884, "count": 1, "min": 0.49486707253430884, "max": 0.49486707253430884}}} #metrics {"StartTime": 1616442591.1384604, "EndTime": 1616442591.1384773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5114603597651083, "count": 1, "min": 0.5114603597651083, "max": 0.5114603597651083}}} #metrics {"StartTime": 1616442591.1385338, "EndTime": 1616442591.1385512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4869164360894097, "count": 1, "min": 0.4869164360894097, "max": 0.4869164360894097}}} #metrics {"StartTime": 1616442591.1386085, "EndTime": 1616442591.1386263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.5097938416496156, "count": 1, "min": 0.5097938416496156, "max": 0.5097938416496156}}} #metrics {"StartTime": 1616442591.138682, "EndTime": 1616442591.1386986, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4675940861777654, "count": 1, "min": 0.4675940861777654, "max": 0.4675940861777654}}} #metrics {"StartTime": 1616442591.1387687, "EndTime": 1616442591.138787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4522581554594494, "count": 1, "min": 0.4522581554594494, "max": 0.4522581554594494}}} #metrics {"StartTime": 1616442591.1388457, "EndTime": 1616442591.1388648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4610433830786004, "count": 1, "min": 0.4610433830786004, "max": 0.4610433830786004}}} #metrics {"StartTime": 1616442591.1389246, "EndTime": 1616442591.1389418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4591590033637153, "count": 1, "min": 0.4591590033637153, "max": 0.4591590033637153}}} #metrics {"StartTime": 1616442591.1390123, "EndTime": 1616442591.1390307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6843943116526124, "count": 1, "min": 0.6843943116526124, "max": 0.6843943116526124}}} #metrics {"StartTime": 1616442591.1390994, "EndTime": 1616442591.1391184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6677792665188905, "count": 1, "min": 0.6677792665188905, "max": 0.6677792665188905}}} #metrics {"StartTime": 1616442591.1391876, "EndTime": 1616442591.1392057, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6893065921843998, "count": 1, "min": 0.6893065921843998, "max": 0.6893065921843998}}} #metrics {"StartTime": 1616442591.1392763, "EndTime": 1616442591.1392958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6889216508814897, "count": 1, "min": 0.6889216508814897, "max": 0.6889216508814897}}} #metrics {"StartTime": 1616442591.1393518, "EndTime": 1616442591.1393692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686362453238674, "count": 1, "min": 0.686362453238674, "max": 0.686362453238674}}} #metrics {"StartTime": 1616442591.1394186, "EndTime": 1616442591.1394358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.733734373062376, "count": 1, "min": 0.733734373062376, "max": 0.733734373062376}}} #metrics {"StartTime": 1616442591.139491, "EndTime": 1616442591.1395087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.7323277387669478, "count": 1, "min": 0.7323277387669478, "max": 0.7323277387669478}}} #metrics {"StartTime": 1616442591.139563, "EndTime": 1616442591.1395788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6978545012297453, "count": 1, "min": 0.6978545012297453, "max": 0.6978545012297453}}} [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.5035481124958664 [2021-03-22 19:49:51.303] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 44, "duration": 132, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442591.4677763, "EndTime": 1616442591.4678504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5138033415141858, "count": 1, "min": 0.5138033415141858, "max": 0.5138033415141858}}} #metrics {"StartTime": 1616442591.4679422, "EndTime": 1616442591.467957, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5364224885639391, "count": 1, "min": 0.5364224885639391, "max": 0.5364224885639391}}} #metrics {"StartTime": 1616442591.4680161, "EndTime": 1616442591.4680343, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5263215315969367, "count": 1, "min": 0.5263215315969367, "max": 0.5263215315969367}}} #metrics {"StartTime": 1616442591.4681032, "EndTime": 1616442591.4681237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.48360001413445725, "count": 1, "min": 0.48360001413445725, "max": 0.48360001413445725}}} #metrics {"StartTime": 1616442591.4681842, "EndTime": 1616442591.468203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22784526222630552, "count": 1, "min": 0.22784526222630552, "max": 0.22784526222630552}}} #metrics {"StartTime": 1616442591.4682643, "EndTime": 1616442591.4682832, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23503313566509046, "count": 1, "min": 0.23503313566509046, "max": 0.23503313566509046}}} #metrics {"StartTime": 1616442591.4683337, "EndTime": 1616442591.4683523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22389140881990133, "count": 1, "min": 0.22389140881990133, "max": 0.22389140881990133}}} #metrics {"StartTime": 1616442591.4684055, "EndTime": 1616442591.4684255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2221017937911184, "count": 1, "min": 0.2221017937911184, "max": 0.2221017937911184}}} #metrics {"StartTime": 1616442591.468475, "EndTime": 1616442591.4684916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5043464259097451, "count": 1, "min": 0.5043464259097451, "max": 0.5043464259097451}}} #metrics {"StartTime": 1616442591.4685466, "EndTime": 1616442591.468564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4749745419150905, "count": 1, "min": 0.4749745419150905, "max": 0.4749745419150905}}} #metrics {"StartTime": 1616442591.4686184, "EndTime": 1616442591.4686286, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5517324748792146, "count": 1, "min": 0.5517324748792146, "max": 0.5517324748792146}}} #metrics {"StartTime": 1616442591.4686592, "EndTime": 1616442591.468666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5074479755602385, "count": 1, "min": 0.5074479755602385, "max": 0.5074479755602385}}} #metrics {"StartTime": 1616442591.468719, "EndTime": 1616442591.4687338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.23755196019222863, "count": 1, "min": 0.23755196019222863, "max": 0.23755196019222863}}} #metrics {"StartTime": 1616442591.4687927, "EndTime": 1616442591.4688084, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22534251965974506, "count": 1, "min": 0.22534251965974506, "max": 0.22534251965974506}}} #metrics {"StartTime": 1616442591.4688623, "EndTime": 1616442591.4688792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.236196558099044, "count": 1, "min": 0.236196558099044, "max": 0.236196558099044}}} #metrics {"StartTime": 1616442591.468935, "EndTime": 1616442591.4689524, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.22709047417891653, "count": 1, "min": 0.22709047417891653, "max": 0.22709047417891653}}} #metrics {"StartTime": 1616442591.4690168, "EndTime": 1616442591.4690363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4995335629111842, "count": 1, "min": 0.4995335629111842, "max": 0.4995335629111842}}} #metrics {"StartTime": 1616442591.4691, "EndTime": 1616442591.469115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5148780019659746, "count": 1, "min": 0.5148780019659746, "max": 0.5148780019659746}}} #metrics {"StartTime": 1616442591.469175, "EndTime": 1616442591.4691913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.49345711155941613, "count": 1, "min": 0.49345711155941613, "max": 0.49345711155941613}}} #metrics {"StartTime": 1616442591.4692464, "EndTime": 1616442591.4692626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.5127755817614104, "count": 1, "min": 0.5127755817614104, "max": 0.5127755817614104}}} #metrics {"StartTime": 1616442591.4693222, "EndTime": 1616442591.4693377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4642922652395148, "count": 1, "min": 0.4642922652395148, "max": 0.4642922652395148}}} #metrics {"StartTime": 1616442591.4693966, "EndTime": 1616442591.469413, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4462908293071546, "count": 1, "min": 0.4462908293071546, "max": 0.4462908293071546}}} #metrics {"StartTime": 1616442591.4694686, "EndTime": 1616442591.469484, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4658054552580181, "count": 1, "min": 0.4658054552580181, "max": 0.4658054552580181}}} #metrics {"StartTime": 1616442591.4695396, "EndTime": 1616442591.4695535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.457621925755551, "count": 1, "min": 0.457621925755551, "max": 0.457621925755551}}} #metrics {"StartTime": 1616442591.4696124, "EndTime": 1616442591.4696295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6873442800421464, "count": 1, "min": 0.6873442800421464, "max": 0.6873442800421464}}} #metrics {"StartTime": 1616442591.4696867, "EndTime": 1616442591.4697056, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6658858449835526, "count": 1, "min": 0.6658858449835526, "max": 0.6658858449835526}}} #metrics {"StartTime": 1616442591.4697726, "EndTime": 1616442591.4697893, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6910464638157895, "count": 1, "min": 0.6910464638157895, "max": 0.6910464638157895}}} #metrics {"StartTime": 1616442591.46986, "EndTime": 1616442591.4698777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6918865806178043, "count": 1, "min": 0.6918865806178043, "max": 0.6918865806178043}}} #metrics {"StartTime": 1616442591.4699798, "EndTime": 1616442591.4700003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7073440551757812, "count": 1, "min": 0.7073440551757812, "max": 0.7073440551757812}}} #metrics {"StartTime": 1616442591.470068, "EndTime": 1616442591.4700859, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7404274388363487, "count": 1, "min": 0.7404274388363487, "max": 0.7404274388363487}}} #metrics {"StartTime": 1616442591.4701421, "EndTime": 1616442591.4701598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.7288984599866365, "count": 1, "min": 0.7288984599866365, "max": 0.7288984599866365}}} #metrics {"StartTime": 1616442591.470213, "EndTime": 1616442591.4702253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6998140837016859, "count": 1, "min": 0.6998140837016859, "max": 0.6998140837016859}}} [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, epoch=14, validation binary_classification_cross_entropy_objective <loss>=0.5138033415141858 [03/22/2021 19:49:51 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:51 INFO 140389653051200] Epoch 14: Loss improved. Updating best model [03/22/2021 19:49:51 INFO 140389653051200] Saving model for epoch: 14 [03/22/2021 19:49:51 INFO 140389653051200] Saved checkpoint to "/tmp/tmpshx3tsah/mx-mod-0000.params" [03/22/2021 19:49:51 INFO 140389653051200] #progress_metric: host=algo-1, completed 100.0 % of epochs #metrics {"StartTime": 1616442591.08519, "EndTime": 1616442591.477448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12852.0, "count": 1, "min": 12852, "max": 12852}, "Total Batches Seen": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Max Records Seen Between Resets": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Number of Records Since Last Reset": {"sum": 756.0, "count": 1, "min": 756, "max": 756}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:51 INFO 140389653051200] #throughput_metric: host=algo-1, train throughput=1926.508221501791 records/second [03/22/2021 19:49:51 WARNING 140389653051200] wait_for_all_workers will not sync workers since the kv store is not running distributed [03/22/2021 19:49:51 WARNING 140389653051200] wait_for_all_workers will not sync workers since the kv store is not running distributed [2021-03-22 19:49:51.643] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 47, "duration": 145, "num_examples": 1, "num_bytes": 14440} [03/22/2021 19:49:51 INFO 140389653051200] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9157894736842992 [03/22/2021 19:49:51 INFO 140389653051200] Epoch 14: Loss improved. Updating best model [2021-03-22 19:49:51.792] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 49, "duration": 5, "num_examples": 1, "num_bytes": 14440} [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.22389140881990133) [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('binary_classification_accuracy', 0.9052631578947369) [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('binary_f_1.000', 0.9032258064516129) [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('precision', 0.9333333333333333) [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('recall', 0.875) [03/22/2021 19:49:51 INFO 140389653051200] #validation_score (algo-1) : ('roc_auc_score', 0.9663120567375887) [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation binary_classification_cross_entropy_objective <loss>=0.22389140881990133 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation binary_classification_accuracy <score>=0.9052631578947369 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation binary_f_1.000 <score>=0.9032258064516129 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation precision <score>=0.9333333333333333 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation recall <score>=0.875 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, validation roc_auc_score <score>=0.9663120567375887 [03/22/2021 19:49:51 INFO 140389653051200] Best model found for hyperparameters: {"optimizer": "adam", "learning_rate": 0.1, "wd": 0.0001, "l1": 0.0, "lr_scheduler_step": 10, "lr_scheduler_factor": 0.99, "lr_scheduler_minimum_lr": 0.0001} [03/22/2021 19:49:51 INFO 140389653051200] Saved checkpoint to "/tmp/tmp4lnyfn5a/mx-mod-0000.params" [2021-03-22 19:49:51.800] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 0, "duration": 6349, "num_examples": 1, "num_bytes": 14440} [2021-03-22 19:49:51.804] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 1, "duration": 3, "num_examples": 1, "num_bytes": 14440} #metrics {"StartTime": 1616442591.8005917, "EndTime": 1616442591.8062384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "test_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 95.0, "count": 1, "min": 95, "max": 95}, "Total Batches Seen": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Max Records Seen Between Resets": {"sum": 95.0, "count": 1, "min": 95, "max": 95}, "Max Batches Seen Between Resets": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Reset Count": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Number of Records Since Last Reset": {"sum": 95.0, "count": 1, "min": 95, "max": 95}, "Number of Batches Since Last Reset": {"sum": 1.0, "count": 1, "min": 1, "max": 1}}} [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.2283941770854749) [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('binary_classification_accuracy', 0.9263157894736842) [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('binary_f_1.000', 0.9247311827956989) [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('precision', 0.9772727272727273) [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('recall', 0.8775510204081632) [03/22/2021 19:49:51 INFO 140389653051200] #test_score (algo-1) : ('roc_auc_score', 0.9569653948535937) [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test binary_classification_cross_entropy_objective <loss>=0.2283941770854749 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test binary_classification_accuracy <score>=0.9263157894736842 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test binary_f_1.000 <score>=0.9247311827956989 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test precision <score>=0.9772727272727273 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test recall <score>=0.8775510204081632 [03/22/2021 19:49:51 INFO 140389653051200] #quality_metric: host=algo-1, test roc_auc_score <score>=0.9569653948535937 #metrics {"StartTime": 1616442585.447828, "EndTime": 1616442591.8110137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training"}, "Metrics": {"initialize.time": {"sum": 161.78226470947266, "count": 1, "min": 161.78226470947266, "max": 161.78226470947266}, "epochs": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "check_early_stopping.time": {"sum": 18.857955932617188, "count": 16, "min": 1.0676383972167969, "max": 1.3720989227294922}, "update.time": {"sum": 5806.211948394775, "count": 15, "min": 325.1452445983887, "max": 492.7980899810791}, "finalize.time": {"sum": 319.7047710418701, "count": 1, "min": 319.7047710418701, "max": 319.7047710418701}, "setuptime": {"sum": 24.35445785522461, "count": 1, "min": 24.35445785522461, "max": 24.35445785522461}, "totaltime": {"sum": 6596.524238586426, "count": 1, "min": 6596.524238586426, "max": 6596.524238586426}}} 2021-03-22 19:50:05 Uploading - Uploading generated training model 2021-03-22 19:50:05 Completed - Training job completed Training seconds: 85 Billable seconds: 85
linear_predictor_balanced = linear_estimator_balanced.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge')
Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
-------------!
predict_batches(linear_predictor_balanced, test_features, test_labels,5)
Accuracy: 0.9263157894736842 Precision: 0.9772727272727273 Recall: 0.8775510204081632
predict_batches(linear_predictor_balanced, train_features, train_labels,5)
Accuracy: 0.9312169312169312 Precision: 0.9655172413793104 Recall: 0.8936170212765957
# Delete inference endpoint
sagemaker.Session().delete_endpoint(linear_predictor_balancedbalanced.endpoint)
The endpoint attribute has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details.
Reducing the number of examples made the recall to go up. Let's try a different strategy, because we need a high recall.
from imblearn.over_sampling import SMOTE
# Drop the columns from your original dataset that you don't need
X = df_train.drop(columns='Target')
# Use the class feature as the labels
y = df_train['Target']
sm = SMOTE(random_state=35)
X_res, y_res = sm.fit_resample(X, y)
Optional: Convert the new dataset to a Pandas DataFrame and check the shape and distribution of the data.
X_res.shape
(566506, 30)
X_res.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | V10 | ... | V21 | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Hour | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | 0.090794 | ... | -0.018307 | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | 0 |
| 1 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | -0.166974 | ... | -0.225775 | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | 0 |
| 2 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | 0.207643 | ... | 0.247998 | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | 0 |
| 3 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | -0.054952 | ... | -0.108300 | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | 0 |
| 4 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | 0.753074 | ... | -0.009431 | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | 0 |
5 rows × 30 columns
smote_df = X_res
smote_df['Target'] = y_res
smote_df.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V7 | V8 | V9 | V10 | ... | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Hour | Target | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 0 | -1.359807 | -0.072781 | 2.536347 | 1.378155 | -0.338321 | 0.462388 | 0.239599 | 0.098698 | 0.363787 | 0.090794 | ... | 0.277838 | -0.110474 | 0.066928 | 0.128539 | -0.189115 | 0.133558 | -0.021053 | 149.62 | 0 | 0 |
| 1 | 1.191857 | 0.266151 | 0.166480 | 0.448154 | 0.060018 | -0.082361 | -0.078803 | 0.085102 | -0.255425 | -0.166974 | ... | -0.638672 | 0.101288 | -0.339846 | 0.167170 | 0.125895 | -0.008983 | 0.014724 | 2.69 | 0 | 0 |
| 2 | -1.358354 | -1.340163 | 1.773209 | 0.379780 | -0.503198 | 1.800499 | 0.791461 | 0.247676 | -1.514654 | 0.207643 | ... | 0.771679 | 0.909412 | -0.689281 | -0.327642 | -0.139097 | -0.055353 | -0.059752 | 378.66 | 0 | 0 |
| 3 | -0.966272 | -0.185226 | 1.792993 | -0.863291 | -0.010309 | 1.247203 | 0.237609 | 0.377436 | -1.387024 | -0.054952 | ... | 0.005274 | -0.190321 | -1.175575 | 0.647376 | -0.221929 | 0.062723 | 0.061458 | 123.50 | 0 | 0 |
| 4 | -1.158233 | 0.877737 | 1.548718 | 0.403034 | -0.407193 | 0.095921 | 0.592941 | -0.270533 | 0.817739 | 0.753074 | ... | 0.798278 | -0.137458 | 0.141267 | -0.206010 | 0.502292 | 0.219422 | 0.215153 | 69.99 | 0 | 0 |
5 rows × 31 columns
smote_df.duplicated().sum()
2804
smote_df.drop_duplicates(inplace=True)
smote_df.duplicated().sum()
0
plt.figure(figsize = (20,10))
correlation_matrix_over = smote_df.corr()
sns.heatmap(correlation_matrix_over, annot=True,fmt=".2f");
plt.title('Correlation After oversampling',fontdict={'size':'18'})
plt.show()
As we see here, there are more correlations after oversampling the data than undersampling it.
So we will remove Again correlated features with 0.89 value.
drop_col = remove_corr(correlation_matrix_over,0.89)
print(drop_col)
smote_df = smote_df.drop(columns=drop_col)
{'V12', 'V17', 'V14', 'V7', 'V18'}
smote_df.shape
(563702, 26)
Create new train, test, and validation datasets.
train_features, test_features, train_labels, test_labels, val_features, val_labels = create_training_sets(smote_df,'Target')
Train your model using the new dataset.
linear_estimator_smote = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
train_instance_count=1,
train_instance_type='ml.m5.xlarge',
predictor_type='binary_classifier')
train_records_smote = linear_estimator_smote.record_set(train_features, train_labels, channel='train')
val_records_smote = linear_estimator_smote.record_set(val_features, val_labels, channel='validation')
test_records_smote = linear_estimator_smote.record_set(test_features, test_labels, channel='test')
linear_estimator_smote.fit([train_records_smote, val_records_smote, test_records_smote])
train_instance_count has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. train_instance_type has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
2021-03-22 20:04:04 Starting - Starting the training job... 2021-03-22 20:04:28 Starting - Launching requested ML instancesProfilerReport-1616443443: InProgress ...... 2021-03-22 20:05:28 Starting - Preparing the instances for training...... 2021-03-22 20:06:28 Downloading - Downloading input data... 2021-03-22 20:07:00 Training - Training image download completed. Training in progress..Docker entrypoint called with argument(s): train Running default environment configuration script [03/22/2021 20:07:04 INFO 140462947600192] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'} [03/22/2021 20:07:04 INFO 140462947600192] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'feature_dim': '25', 'predictor_type': 'binary_classifier', 'mini_batch_size': '1000'} [03/22/2021 20:07:04 INFO 140462947600192] Final configuration: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': '25', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'} [03/22/2021 20:07:04 WARNING 140462947600192] Loggers have already been setup. Process 1 is a worker. [03/22/2021 20:07:04 INFO 140462947600192] Using default worker. [03/22/2021 20:07:05 INFO 140462947600192] Checkpoint loading and saving are disabled. [2021-03-22 20:07:05.153] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:07:05.158] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:07:05.198] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 0, "duration": 48, "num_examples": 1, "num_bytes": 144000} [03/22/2021 20:07:05 INFO 140462947600192] Create Store: local [2021-03-22 20:07:05.283] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 1, "duration": 85, "num_examples": 11, "num_bytes": 1584000} [03/22/2021 20:07:05 INFO 140462947600192] Scaler algorithm parameters <algorithm.scaler.ScalerAlgorithmStable object at 0x7fbfb3724b10> [03/22/2021 20:07:05 INFO 140462947600192] Scaling model computed with parameters: {'stdev_label': None, 'stdev_weight': [ 5.094898 3.3869421 5.8551974 3.0969574 3.8762217 1.5829988 3.5654476 2.1596813 4.217198 2.7409785 0.97301805 0.9165936 3.3547876 1.1903092 0.92190707 1.6825826 0.8779522 0.90087104 0.5446243 0.6163252 0.44019678 0.8641956 0.39091888 243.86818 6.1769314 ] <NDArray 25 @cpu(0)>, 'mean_label': None, 'mean_weight': [-2.10076261e+00 1.68302333e+00 -3.31061625e+00 2.20837665e+00 -1.45482302e+00 -7.35988081e-01 5.50788820e-01 -1.26530623e+00 -2.73893213e+00 1.88440323e+00 -5.73999882e-02 -2.44535208e-02 -1.99966133e+00 3.22832108e-01 2.17183605e-01 2.35554263e-01 3.92262638e-02 -3.19757015e-02 -6.22594282e-02 2.20060870e-02 3.47552821e-02 1.27556399e-01 4.76172753e-02 1.05307724e+02 1.28120003e+01] <NDArray 25 @cpu(0)>} [03/22/2021 20:07:05 INFO 140462947600192] nvidia-smi took: 0.02524256706237793 secs to identify 0 gpus [03/22/2021 20:07:05 INFO 140462947600192] Number of GPUs being used: 0 #metrics {"StartTime": 1616443625.3982756, "EndTime": 1616443625.3983083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "init_train_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12000.0, "count": 1, "min": 12000, "max": 12000}, "Total Batches Seen": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Max Records Seen Between Resets": {"sum": 11000.0, "count": 1, "min": 11000, "max": 11000}, "Max Batches Seen Between Resets": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Reset Count": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Number of Records Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}, "Number of Batches Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}}} [2021-03-22 20:07:16.470] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 3, "duration": 11071, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443636.4703515, "EndTime": 1616443636.4704664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26976728905571834, "count": 1, "min": 0.26976728905571834, "max": 0.26976728905571834}}} #metrics {"StartTime": 1616443636.4705892, "EndTime": 1616443636.470609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2619445829942491, "count": 1, "min": 0.2619445829942491, "max": 0.2619445829942491}}} #metrics {"StartTime": 1616443636.4706533, "EndTime": 1616443636.470665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2808347358194987, "count": 1, "min": 0.2808347358194987, "max": 0.2808347358194987}}} #metrics {"StartTime": 1616443636.470712, "EndTime": 1616443636.4707232, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2667412580023871, "count": 1, "min": 0.2667412580023871, "max": 0.2667412580023871}}} #metrics {"StartTime": 1616443636.4707644, "EndTime": 1616443636.470774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15496321840074329, "count": 1, "min": 0.15496321840074329, "max": 0.15496321840074329}}} #metrics {"StartTime": 1616443636.470817, "EndTime": 1616443636.470828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15457015331692167, "count": 1, "min": 0.15457015331692167, "max": 0.15457015331692167}}} #metrics {"StartTime": 1616443636.4708724, "EndTime": 1616443636.4708834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15427642774793837, "count": 1, "min": 0.15427642774793837, "max": 0.15427642774793837}}} #metrics {"StartTime": 1616443636.470927, "EndTime": 1616443636.470938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15465753723144532, "count": 1, "min": 0.15465753723144532, "max": 0.15465753723144532}}} #metrics {"StartTime": 1616443636.4709811, "EndTime": 1616443636.4709918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2755368925306532, "count": 1, "min": 0.2755368925306532, "max": 0.2755368925306532}}} #metrics {"StartTime": 1616443636.4710298, "EndTime": 1616443636.4710395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.27247168958875867, "count": 1, "min": 0.27247168958875867, "max": 0.27247168958875867}}} #metrics {"StartTime": 1616443636.471077, "EndTime": 1616443636.4710863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26656942525227867, "count": 1, "min": 0.26656942525227867, "max": 0.26656942525227867}}} #metrics {"StartTime": 1616443636.4711294, "EndTime": 1616443636.47114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26785975697835285, "count": 1, "min": 0.26785975697835285, "max": 0.26785975697835285}}} #metrics {"StartTime": 1616443636.471181, "EndTime": 1616443636.4711902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17992738193088106, "count": 1, "min": 0.17992738193088106, "max": 0.17992738193088106}}} #metrics {"StartTime": 1616443636.4712312, "EndTime": 1616443636.4712412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18042501573350694, "count": 1, "min": 0.18042501573350694, "max": 0.18042501573350694}}} #metrics {"StartTime": 1616443636.4712842, "EndTime": 1616443636.4712949, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18035446095784505, "count": 1, "min": 0.18035446095784505, "max": 0.18035446095784505}}} #metrics {"StartTime": 1616443636.4713373, "EndTime": 1616443636.4713469, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1795898035007053, "count": 1, "min": 0.1795898035007053, "max": 0.1795898035007053}}} #metrics {"StartTime": 1616443636.471388, "EndTime": 1616443636.471399, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4553869415283203, "count": 1, "min": 0.4553869415283203, "max": 0.4553869415283203}}} #metrics {"StartTime": 1616443636.4714425, "EndTime": 1616443636.4714537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45205989034016925, "count": 1, "min": 0.45205989034016925, "max": 0.45205989034016925}}} #metrics {"StartTime": 1616443636.471498, "EndTime": 1616443636.471509, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4540563794623481, "count": 1, "min": 0.4540563794623481, "max": 0.4540563794623481}}} #metrics {"StartTime": 1616443636.4715538, "EndTime": 1616443636.4715645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4533508816867404, "count": 1, "min": 0.4533508816867404, "max": 0.4533508816867404}}} #metrics {"StartTime": 1616443636.4716074, "EndTime": 1616443636.4716184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4496841832139757, "count": 1, "min": 0.4496841832139757, "max": 0.4496841832139757}}} #metrics {"StartTime": 1616443636.4716573, "EndTime": 1616443636.4716675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45004119445800783, "count": 1, "min": 0.45004119445800783, "max": 0.45004119445800783}}} #metrics {"StartTime": 1616443636.4717097, "EndTime": 1616443636.4717195, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44963837578667537, "count": 1, "min": 0.44963837578667537, "max": 0.44963837578667537}}} #metrics {"StartTime": 1616443636.4717555, "EndTime": 1616443636.4717653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45007987752278644, "count": 1, "min": 0.45007987752278644, "max": 0.45007987752278644}}} #metrics {"StartTime": 1616443636.471803, "EndTime": 1616443636.4718132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6843651289876302, "count": 1, "min": 0.6843651289876302, "max": 0.6843651289876302}}} #metrics {"StartTime": 1616443636.4718528, "EndTime": 1616443636.471863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854449145507813, "count": 1, "min": 0.6854449145507813, "max": 0.6854449145507813}}} #metrics {"StartTime": 1616443636.4719038, "EndTime": 1616443636.4719148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847846478949653, "count": 1, "min": 0.6847846478949653, "max": 0.6847846478949653}}} #metrics {"StartTime": 1616443636.4719534, "EndTime": 1616443636.4719641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848822816297743, "count": 1, "min": 0.6848822816297743, "max": 0.6848822816297743}}} #metrics {"StartTime": 1616443636.4720058, "EndTime": 1616443636.472018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6870081046549479, "count": 1, "min": 0.6870081046549479, "max": 0.6870081046549479}}} #metrics {"StartTime": 1616443636.4720578, "EndTime": 1616443636.4720685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872150062391493, "count": 1, "min": 0.6872150062391493, "max": 0.6872150062391493}}} #metrics {"StartTime": 1616443636.4721353, "EndTime": 1616443636.4721496, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6871324632432726, "count": 1, "min": 0.6871324632432726, "max": 0.6871324632432726}}} #metrics {"StartTime": 1616443636.472189, "EndTime": 1616443636.4721982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872138525390625, "count": 1, "min": 0.6872138525390625, "max": 0.6872138525390625}}} [03/22/2021 20:07:16 INFO 140462947600192] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.26976728905571834 [2021-03-22 20:07:16.488] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 0, "duration": 11334, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:07:17.595] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 2, "duration": 1107, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443638.4954567, "EndTime": 1616443638.4955244, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20004103536912052, "count": 1, "min": 0.20004103536912052, "max": 0.20004103536912052}}} #metrics {"StartTime": 1616443638.495599, "EndTime": 1616443638.4956098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19091412766047017, "count": 1, "min": 0.19091412766047017, "max": 0.19091412766047017}}} #metrics {"StartTime": 1616443638.495644, "EndTime": 1616443638.495653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2062740774596226, "count": 1, "min": 0.2062740774596226, "max": 0.2062740774596226}}} #metrics {"StartTime": 1616443638.4956853, "EndTime": 1616443638.4956927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19310115931282362, "count": 1, "min": 0.19310115931282362, "max": 0.19310115931282362}}} #metrics {"StartTime": 1616443638.4957244, "EndTime": 1616443638.495732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1432662583547893, "count": 1, "min": 0.1432662583547893, "max": 0.1432662583547893}}} #metrics {"StartTime": 1616443638.495762, "EndTime": 1616443638.4957697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14325363270162542, "count": 1, "min": 0.14325363270162542, "max": 0.14325363270162542}}} #metrics {"StartTime": 1616443638.495805, "EndTime": 1616443638.4958143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14311495664717352, "count": 1, "min": 0.14311495664717352, "max": 0.14311495664717352}}} #metrics {"StartTime": 1616443638.4958525, "EndTime": 1616443638.495862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1434227104112572, "count": 1, "min": 0.1434227104112572, "max": 0.1434227104112572}}} #metrics {"StartTime": 1616443638.495901, "EndTime": 1616443638.4959111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2089723106223217, "count": 1, "min": 0.2089723106223217, "max": 0.2089723106223217}}} #metrics {"StartTime": 1616443638.4959495, "EndTime": 1616443638.495959, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20238040249377717, "count": 1, "min": 0.20238040249377717, "max": 0.20238040249377717}}} #metrics {"StartTime": 1616443638.4959912, "EndTime": 1616443638.4960003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2054710219002413, "count": 1, "min": 0.2054710219002413, "max": 0.2054710219002413}}} #metrics {"StartTime": 1616443638.4960313, "EndTime": 1616443638.4960384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20001879129211847, "count": 1, "min": 0.20001879129211847, "max": 0.20001879129211847}}} #metrics {"StartTime": 1616443638.49607, "EndTime": 1616443638.4960783, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17538610055384452, "count": 1, "min": 0.17538610055384452, "max": 0.17538610055384452}}} #metrics {"StartTime": 1616443638.4961267, "EndTime": 1616443638.4961348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17505503301398856, "count": 1, "min": 0.17505503301398856, "max": 0.17505503301398856}}} #metrics {"StartTime": 1616443638.496163, "EndTime": 1616443638.4961693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17531859942820768, "count": 1, "min": 0.17531859942820768, "max": 0.17531859942820768}}} #metrics {"StartTime": 1616443638.4961889, "EndTime": 1616443638.4961941, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17507563968784995, "count": 1, "min": 0.17507563968784995, "max": 0.17507563968784995}}} #metrics {"StartTime": 1616443638.4962127, "EndTime": 1616443638.4962182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44964406634552884, "count": 1, "min": 0.44964406634552884, "max": 0.44964406634552884}}} #metrics {"StartTime": 1616443638.4962442, "EndTime": 1616443638.49625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44985552901639697, "count": 1, "min": 0.44985552901639697, "max": 0.44985552901639697}}} #metrics {"StartTime": 1616443638.4962683, "EndTime": 1616443638.4962735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496778952730702, "count": 1, "min": 0.4496778952730702, "max": 0.4496778952730702}}} #metrics {"StartTime": 1616443638.4962928, "EndTime": 1616443638.4962993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499536413788605, "count": 1, "min": 0.4499536413788605, "max": 0.4499536413788605}}} #metrics {"StartTime": 1616443638.4963298, "EndTime": 1616443638.4963367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44930021682909793, "count": 1, "min": 0.44930021682909793, "max": 0.44930021682909793}}} #metrics {"StartTime": 1616443638.4963562, "EndTime": 1616443638.4963639, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4483476878016135, "count": 1, "min": 0.4483476878016135, "max": 0.4483476878016135}}} #metrics {"StartTime": 1616443638.496396, "EndTime": 1616443638.496404, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4492889428658965, "count": 1, "min": 0.4492889428658965, "max": 0.4492889428658965}}} #metrics {"StartTime": 1616443638.4964328, "EndTime": 1616443638.4964416, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501661862679062, "count": 1, "min": 0.4501661862679062, "max": 0.4501661862679062}}} #metrics {"StartTime": 1616443638.496472, "EndTime": 1616443638.4964795, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847923791765934, "count": 1, "min": 0.6847923791765934, "max": 0.6847923791765934}}} #metrics {"StartTime": 1616443638.4965103, "EndTime": 1616443638.4965189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845544587345607, "count": 1, "min": 0.6845544587345607, "max": 0.6845544587345607}}} #metrics {"StartTime": 1616443638.496552, "EndTime": 1616443638.496561, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847500795503447, "count": 1, "min": 0.6847500795503447, "max": 0.6847500795503447}}} #metrics {"StartTime": 1616443638.4965937, "EndTime": 1616443638.4966016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845814243199577, "count": 1, "min": 0.6845814243199577, "max": 0.6845814243199577}}} #metrics {"StartTime": 1616443638.4966323, "EndTime": 1616443638.4966407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849995698196278, "count": 1, "min": 0.6849995698196278, "max": 0.6849995698196278}}} #metrics {"StartTime": 1616443638.4966753, "EndTime": 1616443638.4966843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867463016290074, "count": 1, "min": 0.6867463016290074, "max": 0.6867463016290074}}} #metrics {"StartTime": 1616443638.4967158, "EndTime": 1616443638.4967241, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.685180598014167, "count": 1, "min": 0.685180598014167, "max": 0.685180598014167}}} #metrics {"StartTime": 1616443638.4967577, "EndTime": 1616443638.496766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867069901484472, "count": 1, "min": 0.6867069901484472, "max": 0.6867069901484472}}} [03/22/2021 20:07:18 INFO 140462947600192] #quality_metric: host=algo-1, epoch=0, validation binary_classification_cross_entropy_objective <loss>=0.20004103536912052 [03/22/2021 20:07:18 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=sampled_accuracy, value=0.9500266098988824 [03/22/2021 20:07:18 INFO 140462947600192] Epoch 0: Loss improved. Updating best model [03/22/2021 20:07:18 INFO 140462947600192] Saving model for epoch: 0 [03/22/2021 20:07:18 INFO 140462947600192] Saved checkpoint to "/tmp/tmpzctb6azd/mx-mod-0000.params" [03/22/2021 20:07:18 INFO 140462947600192] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs #metrics {"StartTime": 1616443625.3986611, "EndTime": 1616443638.507703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 462961.0, "count": 1, "min": 462961, "max": 462961}, "Total Batches Seen": {"sum": 463.0, "count": 1, "min": 463, "max": 463}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:07:18 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=34400.415491841544 records/second [2021-03-22 20:07:29.869] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 5, "duration": 11357, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443649.8700786, "EndTime": 1616443649.8701577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1847664318169488, "count": 1, "min": 0.1847664318169488, "max": 0.1847664318169488}}} #metrics {"StartTime": 1616443649.8702383, "EndTime": 1616443649.8702502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17468984693739148, "count": 1, "min": 0.17468984693739148, "max": 0.17468984693739148}}} #metrics {"StartTime": 1616443649.8702798, "EndTime": 1616443649.870287, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18961667805989582, "count": 1, "min": 0.18961667805989582, "max": 0.18961667805989582}}} #metrics {"StartTime": 1616443649.8703127, "EndTime": 1616443649.8703194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1763202533976237, "count": 1, "min": 0.1763202533976237, "max": 0.1763202533976237}}} #metrics {"StartTime": 1616443649.8703437, "EndTime": 1616443649.8703501, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1411883002726237, "count": 1, "min": 0.1411883002726237, "max": 0.1411883002726237}}} #metrics {"StartTime": 1616443649.870374, "EndTime": 1616443649.87038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14225948371039496, "count": 1, "min": 0.14225948371039496, "max": 0.14225948371039496}}} #metrics {"StartTime": 1616443649.8704069, "EndTime": 1616443649.8704138, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14105197175767686, "count": 1, "min": 0.14105197175767686, "max": 0.14105197175767686}}} #metrics {"StartTime": 1616443649.8704407, "EndTime": 1616443649.8704474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1423103889465332, "count": 1, "min": 0.1423103889465332, "max": 0.1423103889465332}}} #metrics {"StartTime": 1616443649.8704727, "EndTime": 1616443649.8704789, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19557279507107206, "count": 1, "min": 0.19557279507107206, "max": 0.19557279507107206}}} #metrics {"StartTime": 1616443649.8705022, "EndTime": 1616443649.8705082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18844150275336372, "count": 1, "min": 0.18844150275336372, "max": 0.18844150275336372}}} #metrics {"StartTime": 1616443649.8705328, "EndTime": 1616443649.870539, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19316921193440756, "count": 1, "min": 0.19316921193440756, "max": 0.19316921193440756}}} #metrics {"StartTime": 1616443649.870563, "EndTime": 1616443649.8705692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18693646626790364, "count": 1, "min": 0.18693646626790364, "max": 0.18693646626790364}}} #metrics {"StartTime": 1616443649.8705952, "EndTime": 1616443649.8706012, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1747641532728407, "count": 1, "min": 0.1747641532728407, "max": 0.1747641532728407}}} #metrics {"StartTime": 1616443649.8706255, "EndTime": 1616443649.8706315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17543563690185546, "count": 1, "min": 0.17543563690185546, "max": 0.17543563690185546}}} #metrics {"StartTime": 1616443649.870655, "EndTime": 1616443649.870661, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17474877485487197, "count": 1, "min": 0.17474877485487197, "max": 0.17474877485487197}}} #metrics {"StartTime": 1616443649.8706872, "EndTime": 1616443649.8706934, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17550794453938803, "count": 1, "min": 0.17550794453938803, "max": 0.17550794453938803}}} #metrics {"StartTime": 1616443649.8707168, "EndTime": 1616443649.8707228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477497593858507, "count": 1, "min": 0.4477497593858507, "max": 0.4477497593858507}}} #metrics {"StartTime": 1616443649.8707488, "EndTime": 1616443649.870755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44783197916666667, "count": 1, "min": 0.44783197916666667, "max": 0.44783197916666667}}} #metrics {"StartTime": 1616443649.8707783, "EndTime": 1616443649.8707843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477498536512587, "count": 1, "min": 0.4477498536512587, "max": 0.4477498536512587}}} #metrics {"StartTime": 1616443649.8708074, "EndTime": 1616443649.8708131, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44783141940646704, "count": 1, "min": 0.44783141940646704, "max": 0.44783141940646704}}} #metrics {"StartTime": 1616443649.8708394, "EndTime": 1616443649.8708458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44839983120388455, "count": 1, "min": 0.44839983120388455, "max": 0.44839983120388455}}} #metrics {"StartTime": 1616443649.8708692, "EndTime": 1616443649.8708751, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44920294860839843, "count": 1, "min": 0.44920294860839843, "max": 0.44920294860839843}}} #metrics {"StartTime": 1616443649.8708987, "EndTime": 1616443649.8709054, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4483900326199002, "count": 1, "min": 0.4483900326199002, "max": 0.4483900326199002}}} #metrics {"StartTime": 1616443649.8709314, "EndTime": 1616443649.8709378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44920539557562933, "count": 1, "min": 0.44920539557562933, "max": 0.44920539557562933}}} #metrics {"StartTime": 1616443649.8709624, "EndTime": 1616443649.8709688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848157291666667, "count": 1, "min": 0.6848157291666667, "max": 0.6848157291666667}}} #metrics {"StartTime": 1616443649.870992, "EndTime": 1616443649.870998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848825736490886, "count": 1, "min": 0.6848825736490886, "max": 0.6848825736490886}}} #metrics {"StartTime": 1616443649.8710241, "EndTime": 1616443649.8710303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848149884711372, "count": 1, "min": 0.6848149884711372, "max": 0.6848149884711372}}} #metrics {"StartTime": 1616443649.8710535, "EndTime": 1616443649.8710594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848844304741754, "count": 1, "min": 0.6848844304741754, "max": 0.6848844304741754}}} #metrics {"StartTime": 1616443649.8710828, "EndTime": 1616443649.8710887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6859979897732205, "count": 1, "min": 0.6859979897732205, "max": 0.6859979897732205}}} #metrics {"StartTime": 1616443649.8711114, "EndTime": 1616443649.871117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864556443956163, "count": 1, "min": 0.6864556443956163, "max": 0.6864556443956163}}} #metrics {"StartTime": 1616443649.87114, "EndTime": 1616443649.8711462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860067922634548, "count": 1, "min": 0.6860067922634548, "max": 0.6860067922634548}}} #metrics {"StartTime": 1616443649.8711693, "EndTime": 1616443649.871175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864578952365451, "count": 1, "min": 0.6864578952365451, "max": 0.6864578952365451}}} [03/22/2021 20:07:29 INFO 140462947600192] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.1847664318169488 [2021-03-22 20:07:30.984] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 5, "duration": 1097, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443651.7274282, "EndTime": 1616443651.727494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17566183650876394, "count": 1, "min": 0.17566183650876394, "max": 0.17566183650876394}}} #metrics {"StartTime": 1616443651.727565, "EndTime": 1616443651.7275758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16489431284115588, "count": 1, "min": 0.16489431284115588, "max": 0.16489431284115588}}} #metrics {"StartTime": 1616443651.7276003, "EndTime": 1616443651.7276065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1794434723880288, "count": 1, "min": 0.1794434723880288, "max": 0.1794434723880288}}} #metrics {"StartTime": 1616443651.7276287, "EndTime": 1616443651.7276344, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16605123445796105, "count": 1, "min": 0.16605123445796105, "max": 0.16605123445796105}}} #metrics {"StartTime": 1616443651.7276568, "EndTime": 1616443651.7276623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14130969132982882, "count": 1, "min": 0.14130969132982882, "max": 0.14130969132982882}}} #metrics {"StartTime": 1616443651.727684, "EndTime": 1616443651.727689, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1427650775134574, "count": 1, "min": 0.1427650775134574, "max": 0.1427650775134574}}} #metrics {"StartTime": 1616443651.7277129, "EndTime": 1616443651.7277203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1412746838861817, "count": 1, "min": 0.1412746838861817, "max": 0.1412746838861817}}} #metrics {"StartTime": 1616443651.7277496, "EndTime": 1616443651.727758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1427847716917018, "count": 1, "min": 0.1427847716917018, "max": 0.1427847716917018}}} #metrics {"StartTime": 1616443651.7277899, "EndTime": 1616443651.7277977, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18822913475232872, "count": 1, "min": 0.18822913475232872, "max": 0.18822913475232872}}} #metrics {"StartTime": 1616443651.7278285, "EndTime": 1616443651.7278364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18106209519951189, "count": 1, "min": 0.18106209519951189, "max": 0.18106209519951189}}} #metrics {"StartTime": 1616443651.7278702, "EndTime": 1616443651.727878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1865209065495346, "count": 1, "min": 0.1865209065495346, "max": 0.1865209065495346}}} #metrics {"StartTime": 1616443651.7279112, "EndTime": 1616443651.7279198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18021380397599704, "count": 1, "min": 0.18021380397599704, "max": 0.18021380397599704}}} #metrics {"StartTime": 1616443651.7279515, "EndTime": 1616443651.7279606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421876840691247, "count": 1, "min": 0.17421876840691247, "max": 0.17421876840691247}}} #metrics {"StartTime": 1616443651.7279994, "EndTime": 1616443651.728009, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17516436371288127, "count": 1, "min": 0.17516436371288127, "max": 0.17516436371288127}}} #metrics {"StartTime": 1616443651.7280452, "EndTime": 1616443651.728055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17432523879341694, "count": 1, "min": 0.17432523879341694, "max": 0.17432523879341694}}} #metrics {"StartTime": 1616443651.728109, "EndTime": 1616443651.7281206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1753078767249659, "count": 1, "min": 0.1753078767249659, "max": 0.1753078767249659}}} #metrics {"StartTime": 1616443651.7281592, "EndTime": 1616443651.72817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44960075975289177, "count": 1, "min": 0.44960075975289177, "max": 0.44960075975289177}}} #metrics {"StartTime": 1616443651.7282073, "EndTime": 1616443651.7282164, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44982442295845254, "count": 1, "min": 0.44982442295845254, "max": 0.44982442295845254}}} #metrics {"StartTime": 1616443651.7282417, "EndTime": 1616443651.7282474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44964044803377795, "count": 1, "min": 0.44964044803377795, "max": 0.44964044803377795}}} #metrics {"StartTime": 1616443651.728266, "EndTime": 1616443651.7282708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44996494484725985, "count": 1, "min": 0.44996494484725985, "max": 0.44996494484725985}}} #metrics {"StartTime": 1616443651.7282887, "EndTime": 1616443651.7282937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45594721901220103, "count": 1, "min": 0.45594721901220103, "max": 0.45594721901220103}}} #metrics {"StartTime": 1616443651.728312, "EndTime": 1616443651.728317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4489326914214953, "count": 1, "min": 0.4489326914214953, "max": 0.4489326914214953}}} #metrics {"StartTime": 1616443651.728335, "EndTime": 1616443651.7283397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45597890840685706, "count": 1, "min": 0.45597890840685706, "max": 0.45597890840685706}}} #metrics {"StartTime": 1616443651.728358, "EndTime": 1616443651.728363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4492132685297407, "count": 1, "min": 0.4492132685297407, "max": 0.4492132685297407}}} #metrics {"StartTime": 1616443651.728381, "EndTime": 1616443651.7283857, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847396707120296, "count": 1, "min": 0.6847396707120296, "max": 0.6847396707120296}}} #metrics {"StartTime": 1616443651.7284036, "EndTime": 1616443651.7284098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684566310349986, "count": 1, "min": 0.684566310349986, "max": 0.684566310349986}}} #metrics {"StartTime": 1616443651.728442, "EndTime": 1616443651.7284503, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497398345336, "count": 1, "min": 0.6847497398345336, "max": 0.6847497398345336}}} #metrics {"StartTime": 1616443651.7284844, "EndTime": 1616443651.7284935, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847265763593223, "count": 1, "min": 0.6847265763593223, "max": 0.6847265763593223}}} #metrics {"StartTime": 1616443651.7285266, "EndTime": 1616443651.7285357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853497017777006, "count": 1, "min": 0.6853497017777006, "max": 0.6853497017777006}}} #metrics {"StartTime": 1616443651.7285714, "EndTime": 1616443651.72858, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6874107335124304, "count": 1, "min": 0.6874107335124304, "max": 0.6874107335124304}}} #metrics {"StartTime": 1616443651.7286146, "EndTime": 1616443651.7286232, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855064804891925, "count": 1, "min": 0.6855064804891925, "max": 0.6855064804891925}}} #metrics {"StartTime": 1616443651.7286563, "EndTime": 1616443651.7286646, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6877234017191277, "count": 1, "min": 0.6877234017191277, "max": 0.6877234017191277}}} [03/22/2021 20:07:31 INFO 140462947600192] #quality_metric: host=algo-1, epoch=1, validation binary_classification_cross_entropy_objective <loss>=0.17566183650876394 [03/22/2021 20:07:31 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=sampled_accuracy, value=0.9505233280113536 [03/22/2021 20:07:31 INFO 140462947600192] Epoch 1: Loss improved. Updating best model [03/22/2021 20:07:31 INFO 140462947600192] Saving model for epoch: 1 [03/22/2021 20:07:31 INFO 140462947600192] Saved checkpoint to "/tmp/tmpnb3ayary/mx-mod-0000.params" [03/22/2021 20:07:31 INFO 140462947600192] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs #metrics {"StartTime": 1616443638.5121212, "EndTime": 1616443651.734423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 913922.0, "count": 1, "min": 913922, "max": 913922}, "Total Batches Seen": {"sum": 914.0, "count": 1, "min": 914, "max": 914}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:07:31 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=34105.72129544967 records/second [2021-03-22 20:07:42.474] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 7, "duration": 10737, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443662.474748, "EndTime": 1616443662.474968, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16985383361816406, "count": 1, "min": 0.16985383361816406, "max": 0.16985383361816406}}} #metrics {"StartTime": 1616443662.4750593, "EndTime": 1616443662.4750767, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15863513897365994, "count": 1, "min": 0.15863513897365994, "max": 0.15863513897365994}}} #metrics {"StartTime": 1616443662.4751208, "EndTime": 1616443662.4751306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732056229654948, "count": 1, "min": 0.1732056229654948, "max": 0.1732056229654948}}} #metrics {"StartTime": 1616443662.4751656, "EndTime": 1616443662.4751747, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15970260326809355, "count": 1, "min": 0.15970260326809355, "max": 0.15970260326809355}}} #metrics {"StartTime": 1616443662.4752133, "EndTime": 1616443662.4752223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13983879230075413, "count": 1, "min": 0.13983879230075413, "max": 0.13983879230075413}}} #metrics {"StartTime": 1616443662.475273, "EndTime": 1616443662.4752836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14200427454630535, "count": 1, "min": 0.14200427454630535, "max": 0.14200427454630535}}} #metrics {"StartTime": 1616443662.4753244, "EndTime": 1616443662.475335, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13979966829088, "count": 1, "min": 0.13979966829088, "max": 0.13979966829088}}} #metrics {"StartTime": 1616443662.475372, "EndTime": 1616443662.475382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1420019243537055, "count": 1, "min": 0.1420019243537055, "max": 0.1420019243537055}}} #metrics {"StartTime": 1616443662.4754174, "EndTime": 1616443662.4754279, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18366792863633896, "count": 1, "min": 0.18366792863633896, "max": 0.18366792863633896}}} #metrics {"StartTime": 1616443662.4756613, "EndTime": 1616443662.4756796, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1771691177368164, "count": 1, "min": 0.1771691177368164, "max": 0.1771691177368164}}} #metrics {"StartTime": 1616443662.4757407, "EndTime": 1616443662.4757543, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18230988288031685, "count": 1, "min": 0.18230988288031685, "max": 0.18230988288031685}}} #metrics {"StartTime": 1616443662.4758515, "EndTime": 1616443662.4758656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.176628783976237, "count": 1, "min": 0.176628783976237, "max": 0.176628783976237}}} #metrics {"StartTime": 1616443662.475905, "EndTime": 1616443662.4759169, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17428289187961155, "count": 1, "min": 0.17428289187961155, "max": 0.17428289187961155}}} #metrics {"StartTime": 1616443662.4759607, "EndTime": 1616443662.475972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1754522681681315, "count": 1, "min": 0.1754522681681315, "max": 0.1754522681681315}}} #metrics {"StartTime": 1616443662.4760108, "EndTime": 1616443662.4760213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1742734617445204, "count": 1, "min": 0.1742734617445204, "max": 0.1742734617445204}}} #metrics {"StartTime": 1616443662.4760602, "EndTime": 1616443662.476071, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17549752787272135, "count": 1, "min": 0.17549752787272135, "max": 0.17549752787272135}}} #metrics {"StartTime": 1616443662.4761305, "EndTime": 1616443662.4761422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44772933993869357, "count": 1, "min": 0.44772933993869357, "max": 0.44772933993869357}}} #metrics {"StartTime": 1616443662.4761815, "EndTime": 1616443662.4761915, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44782462361653647, "count": 1, "min": 0.44782462361653647, "max": 0.44782462361653647}}} #metrics {"StartTime": 1616443662.4762316, "EndTime": 1616443662.4762428, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477288390435113, "count": 1, "min": 0.4477288390435113, "max": 0.4477288390435113}}} #metrics {"StartTime": 1616443662.4762814, "EndTime": 1616443662.476292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478236819797092, "count": 1, "min": 0.4478236819797092, "max": 0.4478236819797092}}} #metrics {"StartTime": 1616443662.4763303, "EndTime": 1616443662.4763403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833697543674045, "count": 1, "min": 0.44833697543674045, "max": 0.44833697543674045}}} #metrics {"StartTime": 1616443662.4763803, "EndTime": 1616443662.4763906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4491620296223958, "count": 1, "min": 0.4491620296223958, "max": 0.4491620296223958}}} #metrics {"StartTime": 1616443662.4764292, "EndTime": 1616443662.4764392, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833108879937067, "count": 1, "min": 0.44833108879937067, "max": 0.44833108879937067}}} #metrics {"StartTime": 1616443662.4764798, "EndTime": 1616443662.4764903, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4491599186876085, "count": 1, "min": 0.4491599186876085, "max": 0.4491599186876085}}} #metrics {"StartTime": 1616443662.4765291, "EndTime": 1616443662.4765406, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847873415798611, "count": 1, "min": 0.6847873415798611, "max": 0.6847873415798611}}} #metrics {"StartTime": 1616443662.4765809, "EndTime": 1616443662.4765913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848741008843316, "count": 1, "min": 0.6848741008843316, "max": 0.6848741008843316}}} #metrics {"StartTime": 1616443662.4766283, "EndTime": 1616443662.4766378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847866170247395, "count": 1, "min": 0.6847866170247395, "max": 0.6847866170247395}}} #metrics {"StartTime": 1616443662.4766736, "EndTime": 1616443662.4766839, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848765081108941, "count": 1, "min": 0.6848765081108941, "max": 0.6848765081108941}}} #metrics {"StartTime": 1616443662.4767203, "EndTime": 1616443662.4767303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854663064236111, "count": 1, "min": 0.6854663064236111, "max": 0.6854663064236111}}} #metrics {"StartTime": 1616443662.4767675, "EndTime": 1616443662.4767783, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864741752115885, "count": 1, "min": 0.6864741752115885, "max": 0.6864741752115885}}} #metrics {"StartTime": 1616443662.4768183, "EndTime": 1616443662.4768288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854679029676649, "count": 1, "min": 0.6854679029676649, "max": 0.6854679029676649}}} #metrics {"StartTime": 1616443662.4768674, "EndTime": 1616443662.4768775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864724442545573, "count": 1, "min": 0.6864724442545573, "max": 0.6864724442545573}}} [03/22/2021 20:07:42 INFO 140462947600192] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.16985383361816406 [2021-03-22 20:07:43.535] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 8, "duration": 1044, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443664.2047722, "EndTime": 1616443664.2048342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16682747486785135, "count": 1, "min": 0.16682747486785135, "max": 0.16682747486785135}}} #metrics {"StartTime": 1616443664.2049055, "EndTime": 1616443664.2049196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553768579558487, "count": 1, "min": 0.1553768579558487, "max": 0.1553768579558487}}} #metrics {"StartTime": 1616443664.2049553, "EndTime": 1616443664.2049656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1697468579481611, "count": 1, "min": 0.1697468579481611, "max": 0.1697468579481611}}} #metrics {"StartTime": 1616443664.2049966, "EndTime": 1616443664.2050056, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15625149853922743, "count": 1, "min": 0.15625149853922743, "max": 0.15625149853922743}}} #metrics {"StartTime": 1616443664.2050319, "EndTime": 1616443664.2050412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14105253965693498, "count": 1, "min": 0.14105253965693498, "max": 0.14105253965693498}}} #metrics {"StartTime": 1616443664.2050679, "EndTime": 1616443664.2050753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14302832897999027, "count": 1, "min": 0.14302832897999027, "max": 0.14302832897999027}}} #metrics {"StartTime": 1616443664.2051032, "EndTime": 1616443664.205111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410108003587572, "count": 1, "min": 0.1410108003587572, "max": 0.1410108003587572}}} #metrics {"StartTime": 1616443664.2051423, "EndTime": 1616443664.2051513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14302053500600628, "count": 1, "min": 0.14302053500600628, "max": 0.14302053500600628}}} #metrics {"StartTime": 1616443664.2051775, "EndTime": 1616443664.2051861, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18182364520143485, "count": 1, "min": 0.18182364520143485, "max": 0.18182364520143485}}} #metrics {"StartTime": 1616443664.205223, "EndTime": 1616443664.2052324, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1758885490359282, "count": 1, "min": 0.1758885490359282, "max": 0.1758885490359282}}} #metrics {"StartTime": 1616443664.2052622, "EndTime": 1616443664.2052712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18074516849947542, "count": 1, "min": 0.18074516849947542, "max": 0.18074516849947542}}} #metrics {"StartTime": 1616443664.2053065, "EndTime": 1616443664.2053158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17560230923054254, "count": 1, "min": 0.17560230923054254, "max": 0.17560230923054254}}} #metrics {"StartTime": 1616443664.2053459, "EndTime": 1616443664.205355, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433250201220035, "count": 1, "min": 0.17433250201220035, "max": 0.17433250201220035}}} #metrics {"StartTime": 1616443664.2053883, "EndTime": 1616443664.2053967, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751593472878519, "count": 1, "min": 0.1751593472878519, "max": 0.1751593472878519}}} #metrics {"StartTime": 1616443664.2054262, "EndTime": 1616443664.2054348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743420439661448, "count": 1, "min": 0.1743420439661448, "max": 0.1743420439661448}}} #metrics {"StartTime": 1616443664.2054675, "EndTime": 1616443664.2054753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751812519197327, "count": 1, "min": 0.1751812519197327, "max": 0.1751812519197327}}} #metrics {"StartTime": 1616443664.205506, "EndTime": 1616443664.205515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493836082633091, "count": 1, "min": 0.4493836082633091, "max": 0.4493836082633091}}} #metrics {"StartTime": 1616443664.2055483, "EndTime": 1616443664.2055566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44985095760554566, "count": 1, "min": 0.44985095760554566, "max": 0.44985095760554566}}} #metrics {"StartTime": 1616443664.20559, "EndTime": 1616443664.2056005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449386683571142, "count": 1, "min": 0.449386683571142, "max": 0.449386683571142}}} #metrics {"StartTime": 1616443664.2056313, "EndTime": 1616443664.2056398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498561900411068, "count": 1, "min": 0.4498561900411068, "max": 0.4498561900411068}}} #metrics {"StartTime": 1616443664.2056727, "EndTime": 1616443664.205684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45575404063128866, "count": 1, "min": 0.45575404063128866, "max": 0.45575404063128866}}} #metrics {"StartTime": 1616443664.205715, "EndTime": 1616443664.2057238, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493456461718473, "count": 1, "min": 0.4493456461718473, "max": 0.4493456461718473}}} #metrics {"StartTime": 1616443664.2057567, "EndTime": 1616443664.2057676, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4560138918267765, "count": 1, "min": 0.4560138918267765, "max": 0.4560138918267765}}} #metrics {"StartTime": 1616443664.2057943, "EndTime": 1616443664.2058017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494497291412002, "count": 1, "min": 0.4494497291412002, "max": 0.4494497291412002}}} #metrics {"StartTime": 1616443664.2058337, "EndTime": 1616443664.20584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846063786794768, "count": 1, "min": 0.6846063786794768, "max": 0.6846063786794768}}} #metrics {"StartTime": 1616443664.2058752, "EndTime": 1616443664.2058828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.68468355182555, "count": 1, "min": 0.68468355182555, "max": 0.68468355182555}}} #metrics {"StartTime": 1616443664.2059164, "EndTime": 1616443664.2059252, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847082452400157, "count": 1, "min": 0.6847082452400157, "max": 0.6847082452400157}}} #metrics {"StartTime": 1616443664.2059622, "EndTime": 1616443664.2059712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845976313357026, "count": 1, "min": 0.6845976313357026, "max": 0.6845976313357026}}} #metrics {"StartTime": 1616443664.2060053, "EndTime": 1616443664.206014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.688167707501774, "count": 1, "min": 0.688167707501774, "max": 0.688167707501774}}} #metrics {"StartTime": 1616443664.206038, "EndTime": 1616443664.2060435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6878732643039467, "count": 1, "min": 0.6878732643039467, "max": 0.6878732643039467}}} #metrics {"StartTime": 1616443664.2060645, "EndTime": 1616443664.2060726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6883786680428974, "count": 1, "min": 0.6883786680428974, "max": 0.6883786680428974}}} #metrics {"StartTime": 1616443664.206109, "EndTime": 1616443664.2061188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6890521049668693, "count": 1, "min": 0.6890521049668693, "max": 0.6890521049668693}}} [03/22/2021 20:07:44 INFO 140462947600192] #quality_metric: host=algo-1, epoch=2, validation binary_classification_cross_entropy_objective <loss>=0.16682747486785135 [03/22/2021 20:07:44 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:07:44 INFO 140462947600192] Epoch 2: Loss improved. Updating best model [03/22/2021 20:07:44 INFO 140462947600192] Saving model for epoch: 2 [03/22/2021 20:07:44 INFO 140462947600192] Saved checkpoint to "/tmp/tmp653_syz4/mx-mod-0000.params" [03/22/2021 20:07:44 INFO 140462947600192] #progress_metric: host=algo-1, completed 20.0 % of epochs #metrics {"StartTime": 1616443651.7372952, "EndTime": 1616443664.2113104, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1364883.0, "count": 1, "min": 1364883, "max": 1364883}, "Total Batches Seen": {"sum": 1365.0, "count": 1, "min": 1365, "max": 1365}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:07:44 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=36151.69703918156 records/second [2021-03-22 20:07:55.633] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 9, "duration": 11419, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443675.6332035, "EndTime": 1616443675.63328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16351998894585504, "count": 1, "min": 0.16351998894585504, "max": 0.16351998894585504}}} #metrics {"StartTime": 1616443675.6333556, "EndTime": 1616443675.6333678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15173083811442056, "count": 1, "min": 0.15173083811442056, "max": 0.15173083811442056}}} #metrics {"StartTime": 1616443675.633397, "EndTime": 1616443675.633404, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1662008581882053, "count": 1, "min": 0.1662008581882053, "max": 0.1662008581882053}}} #metrics {"StartTime": 1616443675.633434, "EndTime": 1616443675.633441, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15253453570895725, "count": 1, "min": 0.15253453570895725, "max": 0.15253453570895725}}} #metrics {"StartTime": 1616443675.633469, "EndTime": 1616443675.6334758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1393812479994032, "count": 1, "min": 0.1393812479994032, "max": 0.1393812479994032}}} #metrics {"StartTime": 1616443675.6335022, "EndTime": 1616443675.6335087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14196454298231337, "count": 1, "min": 0.14196454298231337, "max": 0.14196454298231337}}} #metrics {"StartTime": 1616443675.6335354, "EndTime": 1616443675.6335423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13936803129408096, "count": 1, "min": 0.13936803129408096, "max": 0.13936803129408096}}} #metrics {"StartTime": 1616443675.6335695, "EndTime": 1616443675.6335764, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14195914404975044, "count": 1, "min": 0.14195914404975044, "max": 0.14195914404975044}}} #metrics {"StartTime": 1616443675.633603, "EndTime": 1616443675.63361, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1793388878716363, "count": 1, "min": 0.1793388878716363, "max": 0.1793388878716363}}} #metrics {"StartTime": 1616443675.6336339, "EndTime": 1616443675.63364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17430108527289498, "count": 1, "min": 0.17430108527289498, "max": 0.17430108527289498}}} #metrics {"StartTime": 1616443675.6336665, "EndTime": 1616443675.6336732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1784195728556315, "count": 1, "min": 0.1784195728556315, "max": 0.1784195728556315}}} #metrics {"StartTime": 1616443675.6336997, "EndTime": 1616443675.6337056, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17412190155029297, "count": 1, "min": 0.17412190155029297, "max": 0.17412190155029297}}} #metrics {"StartTime": 1616443675.6337306, "EndTime": 1616443675.6337368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1739199456448025, "count": 1, "min": 0.1739199456448025, "max": 0.1739199456448025}}} #metrics {"StartTime": 1616443675.633763, "EndTime": 1616443675.6337693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17542518903944226, "count": 1, "min": 0.17542518903944226, "max": 0.17542518903944226}}} #metrics {"StartTime": 1616443675.6337936, "EndTime": 1616443675.6337998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17391513682047527, "count": 1, "min": 0.17391513682047527, "max": 0.17391513682047527}}} #metrics {"StartTime": 1616443675.633826, "EndTime": 1616443675.6338325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1754542226155599, "count": 1, "min": 0.1754542226155599, "max": 0.1754542226155599}}} #metrics {"StartTime": 1616443675.633859, "EndTime": 1616443675.633865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447714065483941, "count": 1, "min": 0.447714065483941, "max": 0.447714065483941}}} #metrics {"StartTime": 1616443675.6338913, "EndTime": 1616443675.6338975, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447818327094184, "count": 1, "min": 0.447818327094184, "max": 0.447818327094184}}} #metrics {"StartTime": 1616443675.6339252, "EndTime": 1616443675.6339319, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477149814860026, "count": 1, "min": 0.4477149814860026, "max": 0.4477149814860026}}} #metrics {"StartTime": 1616443675.6339552, "EndTime": 1616443675.6339614, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478164329698351, "count": 1, "min": 0.4478164329698351, "max": 0.4478164329698351}}} #metrics {"StartTime": 1616443675.6339848, "EndTime": 1616443675.6339912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4481405008951823, "count": 1, "min": 0.4481405008951823, "max": 0.4481405008951823}}} #metrics {"StartTime": 1616443675.6340144, "EndTime": 1616443675.6340203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490838671196832, "count": 1, "min": 0.4490838671196832, "max": 0.4490838671196832}}} #metrics {"StartTime": 1616443675.6340456, "EndTime": 1616443675.6340525, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44813781717936196, "count": 1, "min": 0.44813781717936196, "max": 0.44813781717936196}}} #metrics {"StartTime": 1616443675.6340802, "EndTime": 1616443675.6340864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490834417046441, "count": 1, "min": 0.4490834417046441, "max": 0.4490834417046441}}} #metrics {"StartTime": 1616443675.6341133, "EndTime": 1616443675.6341197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847693451605903, "count": 1, "min": 0.6847693451605903, "max": 0.6847693451605903}}} #metrics {"StartTime": 1616443675.6341462, "EndTime": 1616443675.6341527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848677715386284, "count": 1, "min": 0.6848677715386284, "max": 0.6848677715386284}}} #metrics {"StartTime": 1616443675.6341794, "EndTime": 1616443675.634186, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847689419216579, "count": 1, "min": 0.6847689419216579, "max": 0.6847689419216579}}} #metrics {"StartTime": 1616443675.6342132, "EndTime": 1616443675.6342194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694725206164, "count": 1, "min": 0.6848694725206164, "max": 0.6848694725206164}}} #metrics {"StartTime": 1616443675.6342466, "EndTime": 1616443675.6342525, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6852227690972222, "count": 1, "min": 0.6852227690972222, "max": 0.6852227690972222}}} #metrics {"StartTime": 1616443675.6342793, "EndTime": 1616443675.6342852, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865127467176649, "count": 1, "min": 0.6865127467176649, "max": 0.6865127467176649}}} #metrics {"StartTime": 1616443675.6343124, "EndTime": 1616443675.6343188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6852232029893663, "count": 1, "min": 0.6852232029893663, "max": 0.6852232029893663}}} #metrics {"StartTime": 1616443675.6343424, "EndTime": 1616443675.6343486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865094026692709, "count": 1, "min": 0.6865094026692709, "max": 0.6865094026692709}}} [03/22/2021 20:07:55 INFO 140462947600192] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.16351998894585504 [2021-03-22 20:07:56.694] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 11, "duration": 1045, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443677.370789, "EndTime": 1616443677.370855, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1625031897419836, "count": 1, "min": 0.1625031897419836, "max": 0.1625031897419836}}} #metrics {"StartTime": 1616443677.370931, "EndTime": 1616443677.3709443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15066525119404559, "count": 1, "min": 0.15066525119404559, "max": 0.15066525119404559}}} #metrics {"StartTime": 1616443677.3709812, "EndTime": 1616443677.370991, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1648865989237067, "count": 1, "min": 0.1648865989237067, "max": 0.1648865989237067}}} #metrics {"StartTime": 1616443677.3710198, "EndTime": 1616443677.3710277, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15133823471245283, "count": 1, "min": 0.15133823471245283, "max": 0.15133823471245283}}} #metrics {"StartTime": 1616443677.3710601, "EndTime": 1616443677.3710694, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144503620682994, "count": 1, "min": 0.14144503620682994, "max": 0.14144503620682994}}} #metrics {"StartTime": 1616443677.371104, "EndTime": 1616443677.3711143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14305455930397531, "count": 1, "min": 0.14305455930397531, "max": 0.14305455930397531}}} #metrics {"StartTime": 1616443677.3711445, "EndTime": 1616443677.3711517, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144344292614125, "count": 1, "min": 0.14144344292614125, "max": 0.14144344292614125}}} #metrics {"StartTime": 1616443677.3711782, "EndTime": 1616443677.371186, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14304550635131597, "count": 1, "min": 0.14304550635131597, "max": 0.14304550635131597}}} #metrics {"StartTime": 1616443677.3712142, "EndTime": 1616443677.371222, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17906153802227123, "count": 1, "min": 0.17906153802227123, "max": 0.17906153802227123}}} #metrics {"StartTime": 1616443677.371254, "EndTime": 1616443677.3712623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17453878367858638, "count": 1, "min": 0.17453878367858638, "max": 0.17453878367858638}}} #metrics {"StartTime": 1616443677.3712924, "EndTime": 1616443677.371301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17828867656659717, "count": 1, "min": 0.17828867656659717, "max": 0.17828867656659717}}} #metrics {"StartTime": 1616443677.3713343, "EndTime": 1616443677.3713439, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17445726717789375, "count": 1, "min": 0.17445726717789375, "max": 0.17445726717789375}}} #metrics {"StartTime": 1616443677.3713753, "EndTime": 1616443677.3713841, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427007050215618, "count": 1, "min": 0.17427007050215618, "max": 0.17427007050215618}}} #metrics {"StartTime": 1616443677.371412, "EndTime": 1616443677.3714204, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17505675717323876, "count": 1, "min": 0.17505675717323876, "max": 0.17505675717323876}}} #metrics {"StartTime": 1616443677.3714535, "EndTime": 1616443677.371463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17428193416328153, "count": 1, "min": 0.17428193416328153, "max": 0.17428193416328153}}} #metrics {"StartTime": 1616443677.3714976, "EndTime": 1616443677.3715065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1750121725182891, "count": 1, "min": 0.1750121725182891, "max": 0.1750121725182891}}} #metrics {"StartTime": 1616443677.371539, "EndTime": 1616443677.3715484, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44946436101247894, "count": 1, "min": 0.44946436101247894, "max": 0.44946436101247894}}} #metrics {"StartTime": 1616443677.3715823, "EndTime": 1616443677.3715923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44978540301090314, "count": 1, "min": 0.44978540301090314, "max": 0.44978540301090314}}} #metrics {"StartTime": 1616443677.3716292, "EndTime": 1616443677.371636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494527021282549, "count": 1, "min": 0.4494527021282549, "max": 0.4494527021282549}}} #metrics {"StartTime": 1616443677.371667, "EndTime": 1616443677.3716772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44975240293580293, "count": 1, "min": 0.44975240293580293, "max": 0.44975240293580293}}} #metrics {"StartTime": 1616443677.3717136, "EndTime": 1616443677.371723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44167462115975503, "count": 1, "min": 0.44167462115975503, "max": 0.44167462115975503}}} #metrics {"StartTime": 1616443677.3717544, "EndTime": 1616443677.3717632, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494702799175994, "count": 1, "min": 0.4494702799175994, "max": 0.4494702799175994}}} #metrics {"StartTime": 1616443677.371798, "EndTime": 1616443677.3718076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44170053863390046, "count": 1, "min": 0.44170053863390046, "max": 0.44170053863390046}}} #metrics {"StartTime": 1616443677.371846, "EndTime": 1616443677.3718553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449530276436744, "count": 1, "min": 0.449530276436744, "max": 0.449530276436744}}} #metrics {"StartTime": 1616443677.371893, "EndTime": 1616443677.371902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845725611209108, "count": 1, "min": 0.6845725611209108, "max": 0.6845725611209108}}} #metrics {"StartTime": 1616443677.3719342, "EndTime": 1616443677.371942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846288034419801, "count": 1, "min": 0.6846288034419801, "max": 0.6846288034419801}}} #metrics {"StartTime": 1616443677.371976, "EndTime": 1616443677.3719845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846486441987996, "count": 1, "min": 0.6846486441987996, "max": 0.6846486441987996}}} #metrics {"StartTime": 1616443677.3720167, "EndTime": 1616443677.3720248, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684626518548624, "count": 1, "min": 0.684626518548624, "max": 0.684626518548624}}} #metrics {"StartTime": 1616443677.3720555, "EndTime": 1616443677.3720634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6859787041442665, "count": 1, "min": 0.6859787041442665, "max": 0.6859787041442665}}} #metrics {"StartTime": 1616443677.3721116, "EndTime": 1616443677.3721206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858253047253533, "count": 1, "min": 0.6858253047253533, "max": 0.6858253047253533}}} #metrics {"StartTime": 1616443677.3721552, "EndTime": 1616443677.3721638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858306657386118, "count": 1, "min": 0.6858306657386118, "max": 0.6858306657386118}}} #metrics {"StartTime": 1616443677.3721972, "EndTime": 1616443677.372206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6870177299603727, "count": 1, "min": 0.6870177299603727, "max": 0.6870177299603727}}} [03/22/2021 20:07:57 INFO 140462947600192] #quality_metric: host=algo-1, epoch=3, validation binary_classification_cross_entropy_objective <loss>=0.1625031897419836 [03/22/2021 20:07:57 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:07:57 INFO 140462947600192] Epoch 3: Loss improved. Updating best model [03/22/2021 20:07:57 INFO 140462947600192] Saving model for epoch: 3 [03/22/2021 20:07:57 INFO 140462947600192] Saved checkpoint to "/tmp/tmpc5tg42ct/mx-mod-0000.params" [03/22/2021 20:07:57 INFO 140462947600192] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs #metrics {"StartTime": 1616443664.213812, "EndTime": 1616443677.3782027, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1815844.0, "count": 1, "min": 1815844, "max": 1815844}, "Total Batches Seen": {"sum": 1816.0, "count": 1, "min": 1816, "max": 1816}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:07:57 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=34255.799868078044 records/second [2021-03-22 20:08:09.062] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 11, "duration": 11681, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443689.0625658, "EndTime": 1616443689.0627723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1601186028205024, "count": 1, "min": 0.1601186028205024, "max": 0.1601186028205024}}} #metrics {"StartTime": 1616443689.0628436, "EndTime": 1616443689.0628579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14802008633083769, "count": 1, "min": 0.14802008633083769, "max": 0.14802008633083769}}} #metrics {"StartTime": 1616443689.0628974, "EndTime": 1616443689.0629053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16250614871554905, "count": 1, "min": 0.16250614871554905, "max": 0.16250614871554905}}} #metrics {"StartTime": 1616443689.0629363, "EndTime": 1616443689.062946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14865621063232423, "count": 1, "min": 0.14865621063232423, "max": 0.14865621063232423}}} #metrics {"StartTime": 1616443689.0629818, "EndTime": 1616443689.0629916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13909910976833767, "count": 1, "min": 0.13909910976833767, "max": 0.13909910976833767}}} #metrics {"StartTime": 1616443689.063025, "EndTime": 1616443689.0630345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14186613345676, "count": 1, "min": 0.14186613345676, "max": 0.14186613345676}}} #metrics {"StartTime": 1616443689.0630627, "EndTime": 1616443689.0630693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.139095986328125, "count": 1, "min": 0.139095986328125, "max": 0.139095986328125}}} #metrics {"StartTime": 1616443689.063097, "EndTime": 1616443689.0631046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14186233932495118, "count": 1, "min": 0.14186233932495118, "max": 0.14186233932495118}}} #metrics {"StartTime": 1616443689.063139, "EndTime": 1616443689.0631483, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17732769087049696, "count": 1, "min": 0.17732769087049696, "max": 0.17732769087049696}}} #metrics {"StartTime": 1616443689.0631907, "EndTime": 1616443689.0632021, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735796127319336, "count": 1, "min": 0.1735796127319336, "max": 0.1735796127319336}}} #metrics {"StartTime": 1616443689.0632422, "EndTime": 1616443689.0632527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17663699849446615, "count": 1, "min": 0.17663699849446615, "max": 0.17663699849446615}}} #metrics {"StartTime": 1616443689.0632973, "EndTime": 1616443689.0633075, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735298446316189, "count": 1, "min": 0.1735298446316189, "max": 0.1735298446316189}}} #metrics {"StartTime": 1616443689.0633512, "EndTime": 1616443689.0633616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737194506157769, "count": 1, "min": 0.1737194506157769, "max": 0.1737194506157769}}} #metrics {"StartTime": 1616443689.0634067, "EndTime": 1616443689.0634177, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17538380147298177, "count": 1, "min": 0.17538380147298177, "max": 0.17538380147298177}}} #metrics {"StartTime": 1616443689.0634615, "EndTime": 1616443689.0634718, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17371811184353297, "count": 1, "min": 0.17371811184353297, "max": 0.17371811184353297}}} #metrics {"StartTime": 1616443689.0635054, "EndTime": 1616443689.063514, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17539857838948567, "count": 1, "min": 0.17539857838948567, "max": 0.17539857838948567}}} #metrics {"StartTime": 1616443689.063553, "EndTime": 1616443689.063563, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44769560255262586, "count": 1, "min": 0.44769560255262586, "max": 0.44769560255262586}}} #metrics {"StartTime": 1616443689.0636022, "EndTime": 1616443689.063612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780997382269966, "count": 1, "min": 0.44780997382269966, "max": 0.44780997382269966}}} #metrics {"StartTime": 1616443689.0636508, "EndTime": 1616443689.0636613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44769591016981336, "count": 1, "min": 0.44769591016981336, "max": 0.44769591016981336}}} #metrics {"StartTime": 1616443689.063688, "EndTime": 1616443689.063694, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478086589219835, "count": 1, "min": 0.4478086589219835, "max": 0.4478086589219835}}} #metrics {"StartTime": 1616443689.063715, "EndTime": 1616443689.063721, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4480250957573785, "count": 1, "min": 0.4480250957573785, "max": 0.4480250957573785}}} #metrics {"StartTime": 1616443689.0637527, "EndTime": 1616443689.0637589, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490056228976779, "count": 1, "min": 0.4490056228976779, "max": 0.4490056228976779}}} #metrics {"StartTime": 1616443689.06378, "EndTime": 1616443689.063787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44802702060275607, "count": 1, "min": 0.44802702060275607, "max": 0.44802702060275607}}} #metrics {"StartTime": 1616443689.0638218, "EndTime": 1616443689.0638304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44900588372124567, "count": 1, "min": 0.44900588372124567, "max": 0.44900588372124567}}} #metrics {"StartTime": 1616443689.0638642, "EndTime": 1616443689.0638745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684755149468316, "count": 1, "min": 0.684755149468316, "max": 0.684755149468316}}} #metrics {"StartTime": 1616443689.0639148, "EndTime": 1616443689.0639248, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848608026801215, "count": 1, "min": 0.6848608026801215, "max": 0.6848608026801215}}} #metrics {"StartTime": 1616443689.0639582, "EndTime": 1616443689.0639684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847553450520834, "count": 1, "min": 0.6847553450520834, "max": 0.6847553450520834}}} #metrics {"StartTime": 1616443689.0640066, "EndTime": 1616443689.0640163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848622878689236, "count": 1, "min": 0.6848622878689236, "max": 0.6848622878689236}}} #metrics {"StartTime": 1616443689.064047, "EndTime": 1616443689.0640564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851455598958334, "count": 1, "min": 0.6851455598958334, "max": 0.6851455598958334}}} #metrics {"StartTime": 1616443689.0641155, "EndTime": 1616443689.0641265, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686576158311632, "count": 1, "min": 0.686576158311632, "max": 0.686576158311632}}} #metrics {"StartTime": 1616443689.0641644, "EndTime": 1616443689.064174, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851455783420138, "count": 1, "min": 0.6851455783420138, "max": 0.6851455783420138}}} #metrics {"StartTime": 1616443689.0642135, "EndTime": 1616443689.0642242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865822184244792, "count": 1, "min": 0.6865822184244792, "max": 0.6865822184244792}}} [03/22/2021 20:08:09 INFO 140462947600192] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.1601186028205024 [2021-03-22 20:08:10.200] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 14, "duration": 1119, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443690.8635895, "EndTime": 1616443690.8636534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1599324934064274, "count": 1, "min": 0.1599324934064274, "max": 0.1599324934064274}}} #metrics {"StartTime": 1616443690.8637245, "EndTime": 1616443690.863736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1479218972073985, "count": 1, "min": 0.1479218972073985, "max": 0.1479218972073985}}} #metrics {"StartTime": 1616443690.8637693, "EndTime": 1616443690.8637786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16214592963938215, "count": 1, "min": 0.16214592963938215, "max": 0.16214592963938215}}} #metrics {"StartTime": 1616443690.8638148, "EndTime": 1616443690.8638237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1484692439386687, "count": 1, "min": 0.1484692439386687, "max": 0.1484692439386687}}} #metrics {"StartTime": 1616443690.8638573, "EndTime": 1616443690.863865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14061785256881673, "count": 1, "min": 0.14061785256881673, "max": 0.14061785256881673}}} #metrics {"StartTime": 1616443690.8638992, "EndTime": 1616443690.8639085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14286178404798064, "count": 1, "min": 0.14286178404798064, "max": 0.14286178404798064}}} #metrics {"StartTime": 1616443690.863945, "EndTime": 1616443690.863954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14061601072713714, "count": 1, "min": 0.14061601072713714, "max": 0.14061601072713714}}} #metrics {"StartTime": 1616443690.8639896, "EndTime": 1616443690.863999, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1428547013116809, "count": 1, "min": 0.1428547013116809, "max": 0.1428547013116809}}} #metrics {"StartTime": 1616443690.864033, "EndTime": 1616443690.8640416, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1776412605203084, "count": 1, "min": 0.1776412605203084, "max": 0.1776412605203084}}} #metrics {"StartTime": 1616443690.8640711, "EndTime": 1616443690.864077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421707984338272, "count": 1, "min": 0.17421707984338272, "max": 0.17421707984338272}}} #metrics {"StartTime": 1616443690.8641222, "EndTime": 1616443690.8641305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17703848746264048, "count": 1, "min": 0.17703848746264048, "max": 0.17703848746264048}}} #metrics {"StartTime": 1616443690.86416, "EndTime": 1616443690.8641655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742021546119364, "count": 1, "min": 0.1742021546119364, "max": 0.1742021546119364}}} #metrics {"StartTime": 1616443690.8641958, "EndTime": 1616443690.8642051, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17477232205734536, "count": 1, "min": 0.17477232205734536, "max": 0.17477232205734536}}} #metrics {"StartTime": 1616443690.8642323, "EndTime": 1616443690.8642406, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174884698558873, "count": 1, "min": 0.174884698558873, "max": 0.174884698558873}}} #metrics {"StartTime": 1616443690.864276, "EndTime": 1616443690.8642852, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17476032075041129, "count": 1, "min": 0.17476032075041129, "max": 0.17476032075041129}}} #metrics {"StartTime": 1616443690.8643227, "EndTime": 1616443690.8643308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17482457630427484, "count": 1, "min": 0.17482457630427484, "max": 0.17482457630427484}}} #metrics {"StartTime": 1616443690.8643644, "EndTime": 1616443690.864373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496300811523957, "count": 1, "min": 0.4496300811523957, "max": 0.4496300811523957}}} #metrics {"StartTime": 1616443690.8644087, "EndTime": 1616443690.8644168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497361742648669, "count": 1, "min": 0.4497361742648669, "max": 0.4497361742648669}}} #metrics {"StartTime": 1616443690.864448, "EndTime": 1616443690.8644567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496486818788321, "count": 1, "min": 0.4496486818788321, "max": 0.4496486818788321}}} #metrics {"StartTime": 1616443690.8644922, "EndTime": 1616443690.864502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44972501020176053, "count": 1, "min": 0.44972501020176053, "max": 0.44972501020176053}}} #metrics {"StartTime": 1616443690.8645413, "EndTime": 1616443690.8645506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4432959972934476, "count": 1, "min": 0.4432959972934476, "max": 0.4432959972934476}}} #metrics {"StartTime": 1616443690.8645892, "EndTime": 1616443690.8645983, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45005700891483585, "count": 1, "min": 0.45005700891483585, "max": 0.45005700891483585}}} #metrics {"StartTime": 1616443690.8646364, "EndTime": 1616443690.864645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4431988004041898, "count": 1, "min": 0.4431988004041898, "max": 0.4431988004041898}}} #metrics {"StartTime": 1616443690.864681, "EndTime": 1616443690.8646898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500859445812475, "count": 1, "min": 0.4500859445812475, "max": 0.4500859445812475}}} #metrics {"StartTime": 1616443690.8647234, "EndTime": 1616443690.8647323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845708904229137, "count": 1, "min": 0.6845708904229137, "max": 0.6845708904229137}}} #metrics {"StartTime": 1616443690.864768, "EndTime": 1616443690.8647773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847514646705085, "count": 1, "min": 0.6847514646705085, "max": 0.6847514646705085}}} #metrics {"StartTime": 1616443690.86481, "EndTime": 1616443690.8648193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847096620308966, "count": 1, "min": 0.6847096620308966, "max": 0.6847096620308966}}} #metrics {"StartTime": 1616443690.8648548, "EndTime": 1616443690.8648634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847314679963127, "count": 1, "min": 0.6847314679963127, "max": 0.6847314679963127}}} #metrics {"StartTime": 1616443690.8648975, "EndTime": 1616443690.864906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850177206594681, "count": 1, "min": 0.6850177206594681, "max": 0.6850177206594681}}} #metrics {"StartTime": 1616443690.8649414, "EndTime": 1616443690.8649504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834116054803572, "count": 1, "min": 0.6834116054803572, "max": 0.6834116054803572}}} #metrics {"StartTime": 1616443690.8649864, "EndTime": 1616443690.8649952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849771626519675, "count": 1, "min": 0.6849771626519675, "max": 0.6849771626519675}}} #metrics {"StartTime": 1616443690.8650258, "EndTime": 1616443690.865032, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834691739111943, "count": 1, "min": 0.6834691739111943, "max": 0.6834691739111943}}} [03/22/2021 20:08:10 INFO 140462947600192] #quality_metric: host=algo-1, epoch=4, validation binary_classification_cross_entropy_objective <loss>=0.1599324934064274 [03/22/2021 20:08:10 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:08:10 INFO 140462947600192] Epoch 4: Loss improved. Updating best model [03/22/2021 20:08:10 INFO 140462947600192] Saving model for epoch: 4 [03/22/2021 20:08:10 INFO 140462947600192] Saved checkpoint to "/tmp/tmpz2tqs9qd/mx-mod-0000.params" [03/22/2021 20:08:10 INFO 140462947600192] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs #metrics {"StartTime": 1616443677.3810596, "EndTime": 1616443690.8702362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2266805.0, "count": 1, "min": 2266805, "max": 2266805}, "Total Batches Seen": {"sum": 2267.0, "count": 1, "min": 2267, "max": 2267}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:08:10 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=33431.01979889151 records/second [2021-03-22 20:08:22.044] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 13, "duration": 11171, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443702.0444784, "EndTime": 1616443702.0445542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15805758877224393, "count": 1, "min": 0.15805758877224393, "max": 0.15805758877224393}}} #metrics {"StartTime": 1616443702.0446281, "EndTime": 1616443702.0446444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14571451246473524, "count": 1, "min": 0.14571451246473524, "max": 0.14571451246473524}}} #metrics {"StartTime": 1616443702.0446873, "EndTime": 1616443702.0446985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16025175235324435, "count": 1, "min": 0.16025175235324435, "max": 0.16025175235324435}}} #metrics {"StartTime": 1616443702.0447345, "EndTime": 1616443702.044745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14624173032972548, "count": 1, "min": 0.14624173032972548, "max": 0.14624173032972548}}} #metrics {"StartTime": 1616443702.0447838, "EndTime": 1616443702.0447948, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885277926974826, "count": 1, "min": 0.13885277926974826, "max": 0.13885277926974826}}} #metrics {"StartTime": 1616443702.0448313, "EndTime": 1616443702.0448427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14174166308932834, "count": 1, "min": 0.14174166308932834, "max": 0.14174166308932834}}} #metrics {"StartTime": 1616443702.04488, "EndTime": 1616443702.0448897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885016153971355, "count": 1, "min": 0.13885016153971355, "max": 0.13885016153971355}}} #metrics {"StartTime": 1616443702.0449293, "EndTime": 1616443702.04494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14173942187839084, "count": 1, "min": 0.14173942187839084, "max": 0.14173942187839084}}} #metrics {"StartTime": 1616443702.0449755, "EndTime": 1616443702.0449872, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17625277913411458, "count": 1, "min": 0.17625277913411458, "max": 0.17625277913411458}}} #metrics {"StartTime": 1616443702.0450213, "EndTime": 1616443702.0450313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17342032508002386, "count": 1, "min": 0.17342032508002386, "max": 0.17342032508002386}}} #metrics {"StartTime": 1616443702.0450704, "EndTime": 1616443702.045081, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17569480017768013, "count": 1, "min": 0.17569480017768013, "max": 0.17569480017768013}}} #metrics {"StartTime": 1616443702.04512, "EndTime": 1616443702.0451295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17340999335394966, "count": 1, "min": 0.17340999335394966, "max": 0.17340999335394966}}} #metrics {"StartTime": 1616443702.0451667, "EndTime": 1616443702.0451784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735784518093533, "count": 1, "min": 0.1735784518093533, "max": 0.1735784518093533}}} #metrics {"StartTime": 1616443702.0452147, "EndTime": 1616443702.045225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753468991088867, "count": 1, "min": 0.1753468991088867, "max": 0.1753468991088867}}} #metrics {"StartTime": 1616443702.0452654, "EndTime": 1616443702.045276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357762773301866, "count": 1, "min": 0.17357762773301866, "max": 0.17357762773301866}}} #metrics {"StartTime": 1616443702.0453146, "EndTime": 1616443702.045325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17535195190429687, "count": 1, "min": 0.17535195190429687, "max": 0.17535195190429687}}} #metrics {"StartTime": 1616443702.045357, "EndTime": 1616443702.0453665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768709601508244, "count": 1, "min": 0.44768709601508244, "max": 0.44768709601508244}}} #metrics {"StartTime": 1616443702.0454066, "EndTime": 1616443702.0454175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478030741373698, "count": 1, "min": 0.4478030741373698, "max": 0.4478030741373698}}} #metrics {"StartTime": 1616443702.045456, "EndTime": 1616443702.0454667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476865138075087, "count": 1, "min": 0.4476865138075087, "max": 0.4476865138075087}}} #metrics {"StartTime": 1616443702.045501, "EndTime": 1616443702.0455112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478024858940972, "count": 1, "min": 0.4478024858940972, "max": 0.4478024858940972}}} #metrics {"StartTime": 1616443702.04555, "EndTime": 1616443702.0455606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478861967637804, "count": 1, "min": 0.4478861967637804, "max": 0.4478861967637804}}} #metrics {"StartTime": 1616443702.0455985, "EndTime": 1616443702.0456095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489593187798394, "count": 1, "min": 0.4489593187798394, "max": 0.4489593187798394}}} #metrics {"StartTime": 1616443702.045642, "EndTime": 1616443702.0456522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44788618021647136, "count": 1, "min": 0.44788618021647136, "max": 0.44788618021647136}}} #metrics {"StartTime": 1616443702.0456905, "EndTime": 1616443702.045702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448959757554796, "count": 1, "min": 0.448959757554796, "max": 0.448959757554796}}} #metrics {"StartTime": 1616443702.0457385, "EndTime": 1616443702.0457485, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847447665744357, "count": 1, "min": 0.6847447665744357, "max": 0.6847447665744357}}} #metrics {"StartTime": 1616443702.0457864, "EndTime": 1616443702.0457954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848555225965712, "count": 1, "min": 0.6848555225965712, "max": 0.6848555225965712}}} #metrics {"StartTime": 1616443702.045834, "EndTime": 1616443702.0458446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847441616482205, "count": 1, "min": 0.6847441616482205, "max": 0.6847441616482205}}} #metrics {"StartTime": 1616443702.0458813, "EndTime": 1616443702.0458915, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848577102322049, "count": 1, "min": 0.6848577102322049, "max": 0.6848577102322049}}} #metrics {"StartTime": 1616443702.0459344, "EndTime": 1616443702.0459452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6849757606336806, "count": 1, "min": 0.6849757606336806, "max": 0.6849757606336806}}} #metrics {"StartTime": 1616443702.0459833, "EndTime": 1616443702.0459943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865579349772135, "count": 1, "min": 0.6865579349772135, "max": 0.6865579349772135}}} #metrics {"StartTime": 1616443702.0460346, "EndTime": 1616443702.046045, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684975628390842, "count": 1, "min": 0.684975628390842, "max": 0.684975628390842}}} #metrics {"StartTime": 1616443702.046082, "EndTime": 1616443702.0460927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865599060058594, "count": 1, "min": 0.6865599060058594, "max": 0.6865599060058594}}} [03/22/2021 20:08:22 INFO 140462947600192] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.15805758877224393 [2021-03-22 20:08:23.192] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 17, "duration": 1130, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443703.8994284, "EndTime": 1616443703.8994937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15833552869600842, "count": 1, "min": 0.15833552869600842, "max": 0.15833552869600842}}} #metrics {"StartTime": 1616443703.8995662, "EndTime": 1616443703.8995774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14611494603342298, "count": 1, "min": 0.14611494603342298, "max": 0.14611494603342298}}} #metrics {"StartTime": 1616443703.899611, "EndTime": 1616443703.8996181, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1603815512177537, "count": 1, "min": 0.1603815512177537, "max": 0.1603815512177537}}} #metrics {"StartTime": 1616443703.8996499, "EndTime": 1616443703.8996692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14657433357394417, "count": 1, "min": 0.14657433357394417, "max": 0.14657433357394417}}} #metrics {"StartTime": 1616443703.8997047, "EndTime": 1616443703.8997142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.140385937923359, "count": 1, "min": 0.140385937923359, "max": 0.140385937923359}}} #metrics {"StartTime": 1616443703.8997476, "EndTime": 1616443703.8997557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14268821376592783, "count": 1, "min": 0.14268821376592783, "max": 0.14268821376592783}}} #metrics {"StartTime": 1616443703.8997886, "EndTime": 1616443703.899797, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1403861179321354, "count": 1, "min": 0.1403861179321354, "max": 0.1403861179321354}}} #metrics {"StartTime": 1616443703.8998291, "EndTime": 1616443703.899838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1426845250748057, "count": 1, "min": 0.1426845250748057, "max": 0.1426845250748057}}} #metrics {"StartTime": 1616443703.89987, "EndTime": 1616443703.8998775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17683866445701427, "count": 1, "min": 0.17683866445701427, "max": 0.17683866445701427}}} #metrics {"StartTime": 1616443703.899907, "EndTime": 1616443703.8999145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415199773794204, "count": 1, "min": 0.17415199773794204, "max": 0.17415199773794204}}} #metrics {"StartTime": 1616443703.8999503, "EndTime": 1616443703.8999581, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17633885438928204, "count": 1, "min": 0.17633885438928204, "max": 0.17633885438928204}}} #metrics {"StartTime": 1616443703.8999913, "EndTime": 1616443703.9000003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415384668523123, "count": 1, "min": 0.17415384668523123, "max": 0.17415384668523123}}} #metrics {"StartTime": 1616443703.9000366, "EndTime": 1616443703.9000459, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17447848398676574, "count": 1, "min": 0.17447848398676574, "max": 0.17447848398676574}}} #metrics {"StartTime": 1616443703.9000843, "EndTime": 1616443703.9001064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1747268411481721, "count": 1, "min": 0.1747268411481721, "max": 0.1747268411481721}}} #metrics {"StartTime": 1616443703.9001422, "EndTime": 1616443703.9001515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1744694652763774, "count": 1, "min": 0.1744694652763774, "max": 0.1744694652763774}}} #metrics {"StartTime": 1616443703.900188, "EndTime": 1616443703.900197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17467271684014207, "count": 1, "min": 0.17467271684014207, "max": 0.17467271684014207}}} #metrics {"StartTime": 1616443703.900232, "EndTime": 1616443703.9002416, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494922442366008, "count": 1, "min": 0.4494922442366008, "max": 0.4494922442366008}}} #metrics {"StartTime": 1616443703.9002795, "EndTime": 1616443703.9002893, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496848151894015, "count": 1, "min": 0.4496848151894015, "max": 0.4496848151894015}}} #metrics {"StartTime": 1616443703.9003239, "EndTime": 1616443703.9003341, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4495299886933916, "count": 1, "min": 0.4495299886933916, "max": 0.4495299886933916}}} #metrics {"StartTime": 1616443703.9003644, "EndTime": 1616443703.900373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496935939332029, "count": 1, "min": 0.4496935939332029, "max": 0.4496935939332029}}} #metrics {"StartTime": 1616443703.9004054, "EndTime": 1616443703.9004154, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44691241989961344, "count": 1, "min": 0.44691241989961344, "max": 0.44691241989961344}}} #metrics {"StartTime": 1616443703.9004548, "EndTime": 1616443703.9004629, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45060132676158915, "count": 1, "min": 0.45060132676158915, "max": 0.45060132676158915}}} #metrics {"StartTime": 1616443703.900499, "EndTime": 1616443703.9005063, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4468613033622889, "count": 1, "min": 0.4468613033622889, "max": 0.4468613033622889}}} #metrics {"StartTime": 1616443703.9005353, "EndTime": 1616443703.900544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506127785680479, "count": 1, "min": 0.4506127785680479, "max": 0.4506127785680479}}} #metrics {"StartTime": 1616443703.9005816, "EndTime": 1616443703.9005904, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.68464277185234, "count": 1, "min": 0.68464277185234, "max": 0.68464277185234}}} #metrics {"StartTime": 1616443703.900624, "EndTime": 1616443703.9006333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849058020298883, "count": 1, "min": 0.6849058020298883, "max": 0.6849058020298883}}} #metrics {"StartTime": 1616443703.9006684, "EndTime": 1616443703.9006777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847597185466144, "count": 1, "min": 0.6847597185466144, "max": 0.6847597185466144}}} #metrics {"StartTime": 1616443703.9007134, "EndTime": 1616443703.9007223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849591146742852, "count": 1, "min": 0.6849591146742852, "max": 0.6849591146742852}}} #metrics {"StartTime": 1616443703.9007597, "EndTime": 1616443703.9007685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847650662960684, "count": 1, "min": 0.6847650662960684, "max": 0.6847650662960684}}} #metrics {"StartTime": 1616443703.900802, "EndTime": 1616443703.9008102, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834993604355847, "count": 1, "min": 0.6834993604355847, "max": 0.6834993604355847}}} #metrics {"StartTime": 1616443703.9008403, "EndTime": 1616443703.900849, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846659661861986, "count": 1, "min": 0.6846659661861986, "max": 0.6846659661861986}}} #metrics {"StartTime": 1616443703.9008846, "EndTime": 1616443703.9008944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835336720031987, "count": 1, "min": 0.6835336720031987, "max": 0.6835336720031987}}} [03/22/2021 20:08:23 INFO 140462947600192] #quality_metric: host=algo-1, epoch=5, validation binary_classification_cross_entropy_objective <loss>=0.15833552869600842 [03/22/2021 20:08:23 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=sampled_accuracy, value=0.9504523682810007 [03/22/2021 20:08:23 INFO 140462947600192] Epoch 5: Loss improved. Updating best model [03/22/2021 20:08:23 INFO 140462947600192] Saving model for epoch: 5 [03/22/2021 20:08:23 INFO 140462947600192] Saved checkpoint to "/tmp/tmpyc5sn4zz/mx-mod-0000.params" [03/22/2021 20:08:23 INFO 140462947600192] #progress_metric: host=algo-1, completed 40.0 % of epochs #metrics {"StartTime": 1616443690.8728275, "EndTime": 1616443703.9061427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2717766.0, "count": 1, "min": 2717766, "max": 2717766}, "Total Batches Seen": {"sum": 2718.0, "count": 1, "min": 2718, "max": 2718}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:08:23 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=34600.34147170264 records/second [2021-03-22 20:08:34.598] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 15, "duration": 10689, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443714.598272, "EndTime": 1616443714.5984838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15674166948106555, "count": 1, "min": 0.15674166948106555, "max": 0.15674166948106555}}} #metrics {"StartTime": 1616443714.5985649, "EndTime": 1616443714.598581, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14412725379096136, "count": 1, "min": 0.14412725379096136, "max": 0.14412725379096136}}} #metrics {"StartTime": 1616443714.5986178, "EndTime": 1616443714.5986254, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15879567240397136, "count": 1, "min": 0.15879567240397136, "max": 0.15879567240397136}}} #metrics {"StartTime": 1616443714.5986555, "EndTime": 1616443714.5986652, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14457233700222438, "count": 1, "min": 0.14457233700222438, "max": 0.14457233700222438}}} #metrics {"StartTime": 1616443714.598708, "EndTime": 1616443714.5987184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870962678697374, "count": 1, "min": 0.13870962678697374, "max": 0.13870962678697374}}} #metrics {"StartTime": 1616443714.59876, "EndTime": 1616443714.5987694, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1415980145263672, "count": 1, "min": 0.1415980145263672, "max": 0.1415980145263672}}} #metrics {"StartTime": 1616443714.5988102, "EndTime": 1616443714.5988216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870781550089517, "count": 1, "min": 0.13870781550089517, "max": 0.13870781550089517}}} #metrics {"StartTime": 1616443714.5988667, "EndTime": 1616443714.5988777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159739820692274, "count": 1, "min": 0.14159739820692274, "max": 0.14159739820692274}}} #metrics {"StartTime": 1616443714.598922, "EndTime": 1616443714.5989332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1756217999267578, "count": 1, "min": 0.1756217999267578, "max": 0.1756217999267578}}} #metrics {"StartTime": 1616443714.598978, "EndTime": 1616443714.598989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338862677680122, "count": 1, "min": 0.17338862677680122, "max": 0.17338862677680122}}} #metrics {"StartTime": 1616443714.5990334, "EndTime": 1616443714.5990446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1751474489678277, "count": 1, "min": 0.1751474489678277, "max": 0.1751474489678277}}} #metrics {"StartTime": 1616443714.5990834, "EndTime": 1616443714.5990937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338921685112849, "count": 1, "min": 0.17338921685112849, "max": 0.17338921685112849}}} #metrics {"StartTime": 1616443714.5991328, "EndTime": 1616443714.5991423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17345560533311633, "count": 1, "min": 0.17345560533311633, "max": 0.17345560533311633}}} #metrics {"StartTime": 1616443714.5991788, "EndTime": 1616443714.5991898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753131539238824, "count": 1, "min": 0.1753131539238824, "max": 0.1753131539238824}}} #metrics {"StartTime": 1616443714.5992289, "EndTime": 1616443714.5992386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17345546061197917, "count": 1, "min": 0.17345546061197917, "max": 0.17345546061197917}}} #metrics {"StartTime": 1616443714.599275, "EndTime": 1616443714.599284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17531529130723741, "count": 1, "min": 0.17531529130723741, "max": 0.17531529130723741}}} #metrics {"StartTime": 1616443714.5993207, "EndTime": 1616443714.5993314, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768542622884117, "count": 1, "min": 0.44768542622884117, "max": 0.44768542622884117}}} #metrics {"StartTime": 1616443714.5993705, "EndTime": 1616443714.5993817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477956292724609, "count": 1, "min": 0.4477956292724609, "max": 0.4477956292724609}}} #metrics {"StartTime": 1616443714.5994773, "EndTime": 1616443714.5994933, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768483167860246, "count": 1, "min": 0.44768483167860246, "max": 0.44768483167860246}}} #metrics {"StartTime": 1616443714.5995467, "EndTime": 1616443714.5995579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477954593234592, "count": 1, "min": 0.4477954593234592, "max": 0.4477954593234592}}} #metrics {"StartTime": 1616443714.599598, "EndTime": 1616443714.599609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478045218234592, "count": 1, "min": 0.4478045218234592, "max": 0.4478045218234592}}} #metrics {"StartTime": 1616443714.5996525, "EndTime": 1616443714.5996633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44892684278700085, "count": 1, "min": 0.44892684278700085, "max": 0.44892684278700085}}} #metrics {"StartTime": 1616443714.5997074, "EndTime": 1616443714.5997183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780452162000867, "count": 1, "min": 0.44780452162000867, "max": 0.44780452162000867}}} #metrics {"StartTime": 1616443714.599758, "EndTime": 1616443714.5997784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489271457248264, "count": 1, "min": 0.4489271457248264, "max": 0.4489271457248264}}} #metrics {"StartTime": 1616443714.5998228, "EndTime": 1616443714.5998328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847385530598958, "count": 1, "min": 0.6847385530598958, "max": 0.6847385530598958}}} #metrics {"StartTime": 1616443714.5998714, "EndTime": 1616443714.599882, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848521276855469, "count": 1, "min": 0.6848521276855469, "max": 0.6848521276855469}}} #metrics {"StartTime": 1616443714.599927, "EndTime": 1616443714.5999374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847382657877604, "count": 1, "min": 0.6847382657877604, "max": 0.6847382657877604}}} #metrics {"StartTime": 1616443714.5999818, "EndTime": 1616443714.5999928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848531834581163, "count": 1, "min": 0.6848531834581163, "max": 0.6848531834581163}}} #metrics {"StartTime": 1616443714.6000311, "EndTime": 1616443714.6000407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694342719184, "count": 1, "min": 0.6848694342719184, "max": 0.6848694342719184}}} #metrics {"StartTime": 1616443714.6000845, "EndTime": 1616443714.6001523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865029634602865, "count": 1, "min": 0.6865029634602865, "max": 0.6865029634602865}}} #metrics {"StartTime": 1616443714.6001973, "EndTime": 1616443714.600208, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848692610677083, "count": 1, "min": 0.6848692610677083, "max": 0.6848692610677083}}} #metrics {"StartTime": 1616443714.6002533, "EndTime": 1616443714.6002653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865034002007379, "count": 1, "min": 0.6865034002007379, "max": 0.6865034002007379}}} [03/22/2021 20:08:34 INFO 140462947600192] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.15674166948106555 [2021-03-22 20:08:35.645] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 20, "duration": 1030, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443716.3223624, "EndTime": 1616443716.3224268, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15729633092415002, "count": 1, "min": 0.15729633092415002, "max": 0.15729633092415002}}} #metrics {"StartTime": 1616443716.322502, "EndTime": 1616443716.322516, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14482137082167418, "count": 1, "min": 0.14482137082167418, "max": 0.14482137082167418}}} #metrics {"StartTime": 1616443716.3225515, "EndTime": 1616443716.3225615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15922872974070248, "count": 1, "min": 0.15922872974070248, "max": 0.15922872974070248}}} #metrics {"StartTime": 1616443716.322595, "EndTime": 1616443716.3226016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1452134667505329, "count": 1, "min": 0.1452134667505329, "max": 0.1452134667505329}}} #metrics {"StartTime": 1616443716.3226314, "EndTime": 1616443716.3226385, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402417312684329, "count": 1, "min": 0.1402417312684329, "max": 0.1402417312684329}}} #metrics {"StartTime": 1616443716.3226645, "EndTime": 1616443716.3226717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1424722315889947, "count": 1, "min": 0.1424722315889947, "max": 0.1424722315889947}}} #metrics {"StartTime": 1616443716.3227043, "EndTime": 1616443716.32271, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402401612670747, "count": 1, "min": 0.1402401612670747, "max": 0.1402401612670747}}} #metrics {"StartTime": 1616443716.3227384, "EndTime": 1616443716.3227463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14247056109401507, "count": 1, "min": 0.14247056109401507, "max": 0.14247056109401507}}} #metrics {"StartTime": 1616443716.3227785, "EndTime": 1616443716.322788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17635394047819514, "count": 1, "min": 0.17635394047819514, "max": 0.17635394047819514}}} #metrics {"StartTime": 1616443716.322819, "EndTime": 1616443716.3228276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741414750745285, "count": 1, "min": 0.1741414750745285, "max": 0.1741414750745285}}} #metrics {"StartTime": 1616443716.3228602, "EndTime": 1616443716.322868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17591849924804515, "count": 1, "min": 0.17591849924804515, "max": 0.17591849924804515}}} #metrics {"StartTime": 1616443716.3229027, "EndTime": 1616443716.3229108, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414645292624867, "count": 1, "min": 0.17414645292624867, "max": 0.17414645292624867}}} #metrics {"StartTime": 1616443716.322948, "EndTime": 1616443716.322957, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433793002120648, "count": 1, "min": 0.17433793002120648, "max": 0.17433793002120648}}} #metrics {"StartTime": 1616443716.3229945, "EndTime": 1616443716.323003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17458672867782238, "count": 1, "min": 0.17458672867782238, "max": 0.17458672867782238}}} #metrics {"StartTime": 1616443716.323036, "EndTime": 1616443716.3230448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17432918592571092, "count": 1, "min": 0.17432918592571092, "max": 0.17432918592571092}}} #metrics {"StartTime": 1616443716.323077, "EndTime": 1616443716.3230855, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17453614770044393, "count": 1, "min": 0.17453614770044393, "max": 0.17453614770044393}}} #metrics {"StartTime": 1616443716.3231196, "EndTime": 1616443716.3231304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44927926543166247, "count": 1, "min": 0.44927926543166247, "max": 0.44927926543166247}}} #metrics {"StartTime": 1616443716.323167, "EndTime": 1616443716.3231766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970080375840565, "count": 1, "min": 0.44970080375840565, "max": 0.44970080375840565}}} #metrics {"StartTime": 1616443716.3232095, "EndTime": 1616443716.323219, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449310677098492, "count": 1, "min": 0.449310677098492, "max": 0.449310677098492}}} #metrics {"StartTime": 1616443716.323254, "EndTime": 1616443716.323264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44971792326976756, "count": 1, "min": 0.44971792326976756, "max": 0.44971792326976756}}} #metrics {"StartTime": 1616443716.3232923, "EndTime": 1616443716.3232996, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44973075234638327, "count": 1, "min": 0.44973075234638327, "max": 0.44973075234638327}}} #metrics {"StartTime": 1616443716.3233292, "EndTime": 1616443716.3233385, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064058816451985, "count": 1, "min": 0.45064058816451985, "max": 0.45064058816451985}}} #metrics {"StartTime": 1616443716.3233724, "EndTime": 1616443716.3233814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44971973851616553, "count": 1, "min": 0.44971973851616553, "max": 0.44971973851616553}}} #metrics {"StartTime": 1616443716.323415, "EndTime": 1616443716.3234234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064280673885293, "count": 1, "min": 0.45064280673885293, "max": 0.45064280673885293}}} #metrics {"StartTime": 1616443716.3234599, "EndTime": 1616443716.3234687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847419867347229, "count": 1, "min": 0.6847419867347229, "max": 0.6847419867347229}}} #metrics {"StartTime": 1616443716.3235023, "EndTime": 1616443716.3235114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849558753283793, "count": 1, "min": 0.6849558753283793, "max": 0.6849558753283793}}} #metrics {"StartTime": 1616443716.3235495, "EndTime": 1616443716.3235579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847582302936028, "count": 1, "min": 0.6847582302936028, "max": 0.6847582302936028}}} #metrics {"StartTime": 1616443716.323579, "EndTime": 1616443716.3235857, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851957704531548, "count": 1, "min": 0.6851957704531548, "max": 0.6851957704531548}}} #metrics {"StartTime": 1616443716.3236136, "EndTime": 1616443716.3236227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497447069516, "count": 1, "min": 0.6847497447069516, "max": 0.6847497447069516}}} #metrics {"StartTime": 1616443716.3236477, "EndTime": 1616443716.3236537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821593271918345, "count": 1, "min": 0.6821593271918345, "max": 0.6821593271918345}}} #metrics {"StartTime": 1616443716.3236828, "EndTime": 1616443716.3236918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846212021991973, "count": 1, "min": 0.6846212021991973, "max": 0.6846212021991973}}} #metrics {"StartTime": 1616443716.3237152, "EndTime": 1616443716.3237207, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821606939050858, "count": 1, "min": 0.6821606939050858, "max": 0.6821606939050858}}} [03/22/2021 20:08:36 INFO 140462947600192] #quality_metric: host=algo-1, epoch=6, validation binary_classification_cross_entropy_objective <loss>=0.15729633092415002 [03/22/2021 20:08:36 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:08:36 INFO 140462947600192] Epoch 6: Loss improved. Updating best model [03/22/2021 20:08:36 INFO 140462947600192] Saving model for epoch: 6 [03/22/2021 20:08:36 INFO 140462947600192] Saved checkpoint to "/tmp/tmpkbx_psnw/mx-mod-0000.params" [03/22/2021 20:08:36 INFO 140462947600192] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs #metrics {"StartTime": 1616443703.9087093, "EndTime": 1616443716.3290899, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3168727.0, "count": 1, "min": 3168727, "max": 3168727}, "Total Batches Seen": {"sum": 3169.0, "count": 1, "min": 3169, "max": 3169}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:08:36 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=36307.80374814302 records/second [2021-03-22 20:08:47.121] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 17, "duration": 10792, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443727.121866, "EndTime": 1616443727.1219704, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15587011271158854, "count": 1, "min": 0.15587011271158854, "max": 0.15587011271158854}}} #metrics {"StartTime": 1616443727.1220458, "EndTime": 1616443727.122059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14294777272542317, "count": 1, "min": 0.14294777272542317, "max": 0.14294777272542317}}} #metrics {"StartTime": 1616443727.1220913, "EndTime": 1616443727.1220992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15782798446655275, "count": 1, "min": 0.15782798446655275, "max": 0.15782798446655275}}} #metrics {"StartTime": 1616443727.122129, "EndTime": 1616443727.122136, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1433309292602539, "count": 1, "min": 0.1433309292602539, "max": 0.1433309292602539}}} #metrics {"StartTime": 1616443727.1221642, "EndTime": 1616443727.1221716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13859164796617296, "count": 1, "min": 0.13859164796617296, "max": 0.13859164796617296}}} #metrics {"StartTime": 1616443727.1221986, "EndTime": 1616443727.1222055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14146294053819444, "count": 1, "min": 0.14146294053819444, "max": 0.14146294053819444}}} #metrics {"StartTime": 1616443727.122232, "EndTime": 1616443727.122239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.138590154232449, "count": 1, "min": 0.138590154232449, "max": 0.138590154232449}}} #metrics {"StartTime": 1616443727.1222653, "EndTime": 1616443727.1222723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14146282268948024, "count": 1, "min": 0.14146282268948024, "max": 0.14146282268948024}}} #metrics {"StartTime": 1616443727.122299, "EndTime": 1616443727.122306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17522680114746095, "count": 1, "min": 0.17522680114746095, "max": 0.17522680114746095}}} #metrics {"StartTime": 1616443727.1223323, "EndTime": 1616443727.1223395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733813762749566, "count": 1, "min": 0.1733813762749566, "max": 0.1733813762749566}}} #metrics {"StartTime": 1616443727.122366, "EndTime": 1616443727.1223729, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17480793009440104, "count": 1, "min": 0.17480793009440104, "max": 0.17480793009440104}}} #metrics {"StartTime": 1616443727.1224, "EndTime": 1616443727.122407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733822572157118, "count": 1, "min": 0.1733822572157118, "max": 0.1733822572157118}}} #metrics {"StartTime": 1616443727.1224375, "EndTime": 1616443727.1224444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733877574327257, "count": 1, "min": 0.1733877574327257, "max": 0.1733877574327257}}} #metrics {"StartTime": 1616443727.1224706, "EndTime": 1616443727.1224775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17528300052218967, "count": 1, "min": 0.17528300052218967, "max": 0.17528300052218967}}} #metrics {"StartTime": 1616443727.122504, "EndTime": 1616443727.1225111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733875675116645, "count": 1, "min": 0.1733875675116645, "max": 0.1733875675116645}}} #metrics {"StartTime": 1616443727.122537, "EndTime": 1616443727.1225438, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1752851186794705, "count": 1, "min": 0.1752851186794705, "max": 0.1752851186794705}}} #metrics {"StartTime": 1616443727.12257, "EndTime": 1616443727.122577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476826897515191, "count": 1, "min": 0.4476826897515191, "max": 0.4476826897515191}}} #metrics {"StartTime": 1616443727.1226027, "EndTime": 1616443727.1226096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44779035115559895, "count": 1, "min": 0.44779035115559895, "max": 0.44779035115559895}}} #metrics {"StartTime": 1616443727.1226363, "EndTime": 1616443727.1226435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768261569552953, "count": 1, "min": 0.44768261569552953, "max": 0.44768261569552953}}} #metrics {"StartTime": 1616443727.1226695, "EndTime": 1616443727.1226768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44779033162434895, "count": 1, "min": 0.44779033162434895, "max": 0.44779033162434895}}} #metrics {"StartTime": 1616443727.122703, "EndTime": 1616443727.12271, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775570190429687, "count": 1, "min": 0.44775570190429687, "max": 0.44775570190429687}}} #metrics {"StartTime": 1616443727.1227362, "EndTime": 1616443727.1227434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489047326660156, "count": 1, "min": 0.4489047326660156, "max": 0.4489047326660156}}} #metrics {"StartTime": 1616443727.1227696, "EndTime": 1616443727.1227765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477557497151693, "count": 1, "min": 0.4477557497151693, "max": 0.4477557497151693}}} #metrics {"StartTime": 1616443727.1228037, "EndTime": 1616443727.1228104, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44890479044596354, "count": 1, "min": 0.44890479044596354, "max": 0.44890479044596354}}} #metrics {"StartTime": 1616443727.1228378, "EndTime": 1616443727.122845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847345876736111, "count": 1, "min": 0.6847345876736111, "max": 0.6847345876736111}}} #metrics {"StartTime": 1616443727.122871, "EndTime": 1616443727.1228776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848488886176215, "count": 1, "min": 0.6848488886176215, "max": 0.6848488886176215}}} #metrics {"StartTime": 1616443727.1229036, "EndTime": 1616443727.1229103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847346805826823, "count": 1, "min": 0.6847346805826823, "max": 0.6847346805826823}}} #metrics {"StartTime": 1616443727.1229365, "EndTime": 1616443727.1229432, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848486611599393, "count": 1, "min": 0.6848486611599393, "max": 0.6848486611599393}}} #metrics {"StartTime": 1616443727.1229694, "EndTime": 1616443727.122976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848240901692708, "count": 1, "min": 0.6848240901692708, "max": 0.6848240901692708}}} #metrics {"StartTime": 1616443727.1230023, "EndTime": 1616443727.123009, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864386622450087, "count": 1, "min": 0.6864386622450087, "max": 0.6864386622450087}}} #metrics {"StartTime": 1616443727.1230352, "EndTime": 1616443727.1230419, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848247833930121, "count": 1, "min": 0.6848247833930121, "max": 0.6848247833930121}}} #metrics {"StartTime": 1616443727.1230679, "EndTime": 1616443727.1230748, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864388231065538, "count": 1, "min": 0.6864388231065538, "max": 0.6864388231065538}}} [03/22/2021 20:08:47 INFO 140462947600192] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.15587011271158854 [2021-03-22 20:08:48.334] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 23, "duration": 1193, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443728.9839292, "EndTime": 1616443728.9839973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15660224212110518, "count": 1, "min": 0.15660224212110518, "max": 0.15660224212110518}}} #metrics {"StartTime": 1616443728.9840713, "EndTime": 1616443728.9840815, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1438427932384654, "count": 1, "min": 0.1438427932384654, "max": 0.1438427932384654}}} #metrics {"StartTime": 1616443728.984134, "EndTime": 1616443728.984143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15845505384682382, "count": 1, "min": 0.15845505384682382, "max": 0.15845505384682382}}} #metrics {"StartTime": 1616443728.9841738, "EndTime": 1616443728.9841812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14417648254524462, "count": 1, "min": 0.14417648254524462, "max": 0.14417648254524462}}} #metrics {"StartTime": 1616443728.984212, "EndTime": 1616443728.9842188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024621037403193, "count": 1, "min": 0.14024621037403193, "max": 0.14024621037403193}}} #metrics {"StartTime": 1616443728.9842455, "EndTime": 1616443728.9842536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.142366892009503, "count": 1, "min": 0.142366892009503, "max": 0.142366892009503}}} #metrics {"StartTime": 1616443728.984288, "EndTime": 1616443728.9842973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402444858087469, "count": 1, "min": 0.1402444858087469, "max": 0.1402444858087469}}} #metrics {"StartTime": 1616443728.9843304, "EndTime": 1616443728.98434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1423659780250916, "count": 1, "min": 0.1423659780250916, "max": 0.1423659780250916}}} #metrics {"StartTime": 1616443728.9843748, "EndTime": 1616443728.9843843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17604264087957844, "count": 1, "min": 0.17604264087957844, "max": 0.17604264087957844}}} #metrics {"StartTime": 1616443728.9844167, "EndTime": 1616443728.9844232, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414621018509038, "count": 1, "min": 0.17414621018509038, "max": 0.17414621018509038}}} #metrics {"StartTime": 1616443728.9844441, "EndTime": 1616443728.984452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1756515712714352, "count": 1, "min": 0.1756515712714352, "max": 0.1756515712714352}}} #metrics {"StartTime": 1616443728.9844782, "EndTime": 1616443728.9844851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741523136330429, "count": 1, "min": 0.1741523136330429, "max": 0.1741523136330429}}} #metrics {"StartTime": 1616443728.9845164, "EndTime": 1616443728.9845257, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420705091832736, "count": 1, "min": 0.17420705091832736, "max": 0.17420705091832736}}} #metrics {"StartTime": 1616443728.9845638, "EndTime": 1616443728.9845734, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17463607314378632, "count": 1, "min": 0.17463607314378632, "max": 0.17463607314378632}}} #metrics {"StartTime": 1616443728.9846058, "EndTime": 1616443728.9846146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420281786983774, "count": 1, "min": 0.17420281786983774, "max": 0.17420281786983774}}} #metrics {"StartTime": 1616443728.9846506, "EndTime": 1616443728.9846597, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17459016833424632, "count": 1, "min": 0.17459016833424632, "max": 0.17459016833424632}}} #metrics {"StartTime": 1616443728.9846895, "EndTime": 1616443728.9846985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44911066596339266, "count": 1, "min": 0.44911066596339266, "max": 0.44911066596339266}}} #metrics {"StartTime": 1616443728.9847248, "EndTime": 1616443728.9847345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970983722139296, "count": 1, "min": 0.44970983722139296, "max": 0.44970983722139296}}} #metrics {"StartTime": 1616443728.9847648, "EndTime": 1616443728.9847736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912775542817684, "count": 1, "min": 0.44912775542817684, "max": 0.44912775542817684}}} #metrics {"StartTime": 1616443728.9848063, "EndTime": 1616443728.984815, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44972761667470507, "count": 1, "min": 0.44972761667470507, "max": 0.44972761667470507}}} #metrics {"StartTime": 1616443728.9848433, "EndTime": 1616443728.9848526, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45058304707336155, "count": 1, "min": 0.45058304707336155, "max": 0.45058304707336155}}} #metrics {"StartTime": 1616443728.9848824, "EndTime": 1616443728.9848914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45015655268543425, "count": 1, "min": 0.45015655268543425, "max": 0.45015655268543425}}} #metrics {"StartTime": 1616443728.9849226, "EndTime": 1616443728.9849308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45057923575971953, "count": 1, "min": 0.45057923575971953, "max": 0.45057923575971953}}} #metrics {"StartTime": 1616443728.984958, "EndTime": 1616443728.9849677, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45015732577575823, "count": 1, "min": 0.45015732577575823, "max": 0.45015732577575823}}} #metrics {"StartTime": 1616443728.9849946, "EndTime": 1616443728.9850032, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847964173283627, "count": 1, "min": 0.6847964173283627, "max": 0.6847964173283627}}} #metrics {"StartTime": 1616443728.9850304, "EndTime": 1616443728.985039, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849860845907203, "count": 1, "min": 0.6849860845907203, "max": 0.6849860845907203}}} #metrics {"StartTime": 1616443728.9850638, "EndTime": 1616443728.9850724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847697194552662, "count": 1, "min": 0.6847697194552662, "max": 0.6847697194552662}}} #metrics {"StartTime": 1616443728.9851003, "EndTime": 1616443728.985106, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853051505529523, "count": 1, "min": 0.6853051505529523, "max": 0.6853051505529523}}} #metrics {"StartTime": 1616443728.9851243, "EndTime": 1616443728.9851315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845692088973211, "count": 1, "min": 0.6845692088973211, "max": 0.6845692088973211}}} #metrics {"StartTime": 1616443728.9851568, "EndTime": 1616443728.985165, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6822623024981602, "count": 1, "min": 0.6822623024981602, "max": 0.6822623024981602}}} #metrics {"StartTime": 1616443728.98519, "EndTime": 1616443728.985198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844077946214742, "count": 1, "min": 0.6844077946214742, "max": 0.6844077946214742}}} #metrics {"StartTime": 1616443728.9852278, "EndTime": 1616443728.9852366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682262466806923, "count": 1, "min": 0.682262466806923, "max": 0.682262466806923}}} [03/22/2021 20:08:48 INFO 140462947600192] #quality_metric: host=algo-1, epoch=7, validation binary_classification_cross_entropy_objective <loss>=0.15660224212110518 [03/22/2021 20:08:48 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:08:48 INFO 140462947600192] Epoch 7: Loss improved. Updating best model [03/22/2021 20:08:48 INFO 140462947600192] Saving model for epoch: 7 [03/22/2021 20:08:48 INFO 140462947600192] Saved checkpoint to "/tmp/tmp8jpysen4/mx-mod-0000.params" [03/22/2021 20:08:48 INFO 140462947600192] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs #metrics {"StartTime": 1616443716.3293319, "EndTime": 1616443728.9906275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3619688.0, "count": 1, "min": 3619688, "max": 3619688}, "Total Batches Seen": {"sum": 3620.0, "count": 1, "min": 3620, "max": 3620}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:08:48 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=35616.94285622394 records/second [2021-03-22 20:08:59.966] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 19, "duration": 10973, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443739.9668424, "EndTime": 1616443739.9669287, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15528282518174913, "count": 1, "min": 0.15528282518174913, "max": 0.15528282518174913}}} #metrics {"StartTime": 1616443739.9670136, "EndTime": 1616443739.9670312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14202935597737631, "count": 1, "min": 0.14202935597737631, "max": 0.14202935597737631}}} #metrics {"StartTime": 1616443739.9670732, "EndTime": 1616443739.967085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15717111116197374, "count": 1, "min": 0.15717111116197374, "max": 0.15717111116197374}}} #metrics {"StartTime": 1616443739.9671257, "EndTime": 1616443739.9671361, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14235929941813152, "count": 1, "min": 0.14235929941813152, "max": 0.14235929941813152}}} #metrics {"StartTime": 1616443739.9671776, "EndTime": 1616443739.9671888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13852168887668187, "count": 1, "min": 0.13852168887668187, "max": 0.13852168887668187}}} #metrics {"StartTime": 1616443739.9672291, "EndTime": 1616443739.967239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14134579871283637, "count": 1, "min": 0.14134579871283637, "max": 0.14134579871283637}}} #metrics {"StartTime": 1616443739.9672804, "EndTime": 1616443739.9672906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1385202995469835, "count": 1, "min": 0.1385202995469835, "max": 0.1385202995469835}}} #metrics {"StartTime": 1616443739.9673302, "EndTime": 1616443739.9673421, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14134585993448892, "count": 1, "min": 0.14134585993448892, "max": 0.14134585993448892}}} #metrics {"StartTime": 1616443739.9673824, "EndTime": 1616443739.967393, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496830325656468, "count": 1, "min": 0.17496830325656468, "max": 0.17496830325656468}}} #metrics {"StartTime": 1616443739.9674308, "EndTime": 1616443739.9674423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733770851304796, "count": 1, "min": 0.1733770851304796, "max": 0.1733770851304796}}} #metrics {"StartTime": 1616443739.9674797, "EndTime": 1616443739.9674914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1745865201144748, "count": 1, "min": 0.1745865201144748, "max": 0.1745865201144748}}} #metrics {"StartTime": 1616443739.9675317, "EndTime": 1616443739.9675424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337771436903213, "count": 1, "min": 0.17337771436903213, "max": 0.17337771436903213}}} #metrics {"StartTime": 1616443739.967582, "EndTime": 1616443739.967592, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17332972059461804, "count": 1, "min": 0.17332972059461804, "max": 0.17332972059461804}}} #metrics {"StartTime": 1616443739.9676287, "EndTime": 1616443739.9676394, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17524100162082248, "count": 1, "min": 0.17524100162082248, "max": 0.17524100162082248}}} #metrics {"StartTime": 1616443739.967678, "EndTime": 1616443739.9676888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17332956634521485, "count": 1, "min": 0.17332956634521485, "max": 0.17332956634521485}}} #metrics {"StartTime": 1616443739.9677286, "EndTime": 1616443739.967739, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17524264821370442, "count": 1, "min": 0.17524264821370442, "max": 0.17524264821370442}}} #metrics {"StartTime": 1616443739.967778, "EndTime": 1616443739.9677885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476809965684679, "count": 1, "min": 0.4476809965684679, "max": 0.4476809965684679}}} #metrics {"StartTime": 1616443739.9678261, "EndTime": 1616443739.9678373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477842588297526, "count": 1, "min": 0.4477842588297526, "max": 0.4477842588297526}}} #metrics {"StartTime": 1616443739.9678748, "EndTime": 1616443739.9678857, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476814961073134, "count": 1, "min": 0.4476814961073134, "max": 0.4476814961073134}}} #metrics {"StartTime": 1616443739.967926, "EndTime": 1616443739.967937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447784270968967, "count": 1, "min": 0.447784270968967, "max": 0.447784270968967}}} #metrics {"StartTime": 1616443739.9679754, "EndTime": 1616443739.9679873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477248346625434, "count": 1, "min": 0.4477248346625434, "max": 0.4477248346625434}}} #metrics {"StartTime": 1616443739.9680269, "EndTime": 1616443739.9680378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44885368862575953, "count": 1, "min": 0.44885368862575953, "max": 0.44885368862575953}}} #metrics {"StartTime": 1616443739.968076, "EndTime": 1616443739.9681053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44772474127875433, "count": 1, "min": 0.44772474127875433, "max": 0.44772474127875433}}} #metrics {"StartTime": 1616443739.968149, "EndTime": 1616443739.9681602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4488536539713542, "count": 1, "min": 0.4488536539713542, "max": 0.4488536539713542}}} #metrics {"StartTime": 1616443739.9681983, "EndTime": 1616443739.9682102, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320947265625, "count": 1, "min": 0.6847320947265625, "max": 0.6847320947265625}}} #metrics {"StartTime": 1616443739.968249, "EndTime": 1616443739.9682596, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684845260281033, "count": 1, "min": 0.684845260281033, "max": 0.684845260281033}}} #metrics {"StartTime": 1616443739.9682975, "EndTime": 1616443739.9683077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847326047092014, "count": 1, "min": 0.6847326047092014, "max": 0.6847326047092014}}} #metrics {"StartTime": 1616443739.9683468, "EndTime": 1616443739.968357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848448480902778, "count": 1, "min": 0.6848448480902778, "max": 0.6848448480902778}}} #metrics {"StartTime": 1616443739.968396, "EndTime": 1616443739.9684076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847987448459202, "count": 1, "min": 0.6847987448459202, "max": 0.6847987448459202}}} #metrics {"StartTime": 1616443739.9684472, "EndTime": 1616443739.9684582, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863899905056423, "count": 1, "min": 0.6863899905056423, "max": 0.6863899905056423}}} #metrics {"StartTime": 1616443739.9684975, "EndTime": 1616443739.968508, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847984905327691, "count": 1, "min": 0.6847984905327691, "max": 0.6847984905327691}}} #metrics {"StartTime": 1616443739.968547, "EndTime": 1616443739.9685574, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863900557454428, "count": 1, "min": 0.6863900557454428, "max": 0.6863900557454428}}} [03/22/2021 20:08:59 INFO 140462947600192] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.15528282518174913 [2021-03-22 20:09:01.090] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 26, "duration": 1101, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443741.8979404, "EndTime": 1616443741.89805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15613335891461064, "count": 1, "min": 0.15613335891461064, "max": 0.15613335891461064}}} #metrics {"StartTime": 1616443741.8981543, "EndTime": 1616443741.8981693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14308589538065322, "count": 1, "min": 0.14308589538065322, "max": 0.14308589538065322}}} #metrics {"StartTime": 1616443741.8982134, "EndTime": 1616443741.8982227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15791797451840153, "count": 1, "min": 0.15791797451840153, "max": 0.15791797451840153}}} #metrics {"StartTime": 1616443741.8982625, "EndTime": 1616443741.8982716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14336853764973698, "count": 1, "min": 0.14336853764973698, "max": 0.14336853764973698}}} #metrics {"StartTime": 1616443741.8983061, "EndTime": 1616443741.8983142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026178370474585, "count": 1, "min": 0.14026178370474585, "max": 0.14026178370474585}}} #metrics {"StartTime": 1616443741.8983505, "EndTime": 1616443741.8983588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220743651336784, "count": 1, "min": 0.14220743651336784, "max": 0.14220743651336784}}} #metrics {"StartTime": 1616443741.8983927, "EndTime": 1616443741.8984005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026066034170506, "count": 1, "min": 0.14026066034170506, "max": 0.14026066034170506}}} #metrics {"StartTime": 1616443741.8984337, "EndTime": 1616443741.8984418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220671708731442, "count": 1, "min": 0.14220671708731442, "max": 0.14220671708731442}}} #metrics {"StartTime": 1616443741.8984747, "EndTime": 1616443741.898483, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17583435285973256, "count": 1, "min": 0.17583435285973256, "max": 0.17583435285973256}}} #metrics {"StartTime": 1616443741.898518, "EndTime": 1616443741.8985262, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741533048994177, "count": 1, "min": 0.1741533048994177, "max": 0.1741533048994177}}} #metrics {"StartTime": 1616443741.8985586, "EndTime": 1616443741.8985667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1754717469701789, "count": 1, "min": 0.1754717469701789, "max": 0.1754717469701789}}} #metrics {"StartTime": 1616443741.8985996, "EndTime": 1616443741.8986077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741601102462533, "count": 1, "min": 0.1741601102462533, "max": 0.1741601102462533}}} #metrics {"StartTime": 1616443741.8986402, "EndTime": 1616443741.8986483, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17425598671023085, "count": 1, "min": 0.17425598671023085, "max": 0.17425598671023085}}} #metrics {"StartTime": 1616443741.8986819, "EndTime": 1616443741.8986897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17495282646694862, "count": 1, "min": 0.17495282646694862, "max": 0.17495282646694862}}} #metrics {"StartTime": 1616443741.898723, "EndTime": 1616443741.8987308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17425392324120437, "count": 1, "min": 0.17425392324120437, "max": 0.17425392324120437}}} #metrics {"StartTime": 1616443741.8987634, "EndTime": 1616443741.8987715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174917476532919, "count": 1, "min": 0.174917476532919, "max": 0.174917476532919}}} #metrics {"StartTime": 1616443741.8988035, "EndTime": 1616443741.8988113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44897305480296545, "count": 1, "min": 0.44897305480296545, "max": 0.44897305480296545}}} #metrics {"StartTime": 1616443741.8988445, "EndTime": 1616443741.898852, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497754167195053, "count": 1, "min": 0.4497754167195053, "max": 0.4497754167195053}}} #metrics {"StartTime": 1616443741.8988843, "EndTime": 1616443741.8988924, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490292134808589, "count": 1, "min": 0.4490292134808589, "max": 0.4490292134808589}}} #metrics {"StartTime": 1616443741.8989246, "EndTime": 1616443741.8989325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44979062678438775, "count": 1, "min": 0.44979062678438775, "max": 0.44979062678438775}}} #metrics {"StartTime": 1616443741.8989654, "EndTime": 1616443741.8989732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45019092569965324, "count": 1, "min": 0.45019092569965324, "max": 0.45019092569965324}}} #metrics {"StartTime": 1616443741.899006, "EndTime": 1616443741.899014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499556063167673, "count": 1, "min": 0.4499556063167673, "max": 0.4499556063167673}}} #metrics {"StartTime": 1616443741.8990464, "EndTime": 1616443741.8990543, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45019315293606277, "count": 1, "min": 0.45019315293606277, "max": 0.45019315293606277}}} #metrics {"StartTime": 1616443741.8990874, "EndTime": 1616443741.8990953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44995695678862524, "count": 1, "min": 0.44995695678862524, "max": 0.44995695678862524}}} #metrics {"StartTime": 1616443741.8991277, "EndTime": 1616443741.8991358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847951012341207, "count": 1, "min": 0.6847951012341207, "max": 0.6847951012341207}}} #metrics {"StartTime": 1616443741.8991685, "EndTime": 1616443741.8991766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850502911497139, "count": 1, "min": 0.6850502911497139, "max": 0.6850502911497139}}} #metrics {"StartTime": 1616443741.8992093, "EndTime": 1616443741.8992171, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847619682502848, "count": 1, "min": 0.6847619682502848, "max": 0.6847619682502848}}} #metrics {"StartTime": 1616443741.8992493, "EndTime": 1616443741.8992574, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852790766200508, "count": 1, "min": 0.6852790766200508, "max": 0.6852790766200508}}} #metrics {"StartTime": 1616443741.8992908, "EndTime": 1616443741.899299, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842289395253667, "count": 1, "min": 0.6842289395253667, "max": 0.6842289395253667}}} #metrics {"StartTime": 1616443741.8993309, "EndTime": 1616443741.8993387, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835660641088075, "count": 1, "min": 0.6835660641088075, "max": 0.6835660641088075}}} #metrics {"StartTime": 1616443741.8993707, "EndTime": 1616443741.8993788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842748672082024, "count": 1, "min": 0.6842748672082024, "max": 0.6842748672082024}}} #metrics {"StartTime": 1616443741.8994114, "EndTime": 1616443741.8994193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835661401726664, "count": 1, "min": 0.6835661401726664, "max": 0.6835661401726664}}} [03/22/2021 20:09:01 INFO 140462947600192] #quality_metric: host=algo-1, epoch=8, validation binary_classification_cross_entropy_objective <loss>=0.15613335891461064 [03/22/2021 20:09:01 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:09:01 INFO 140462947600192] Epoch 8: Loss improved. Updating best model [03/22/2021 20:09:01 INFO 140462947600192] Saving model for epoch: 8 [03/22/2021 20:09:01 INFO 140462947600192] Saved checkpoint to "/tmp/tmp3iavtuvf/mx-mod-0000.params" [03/22/2021 20:09:01 INFO 140462947600192] #progress_metric: host=algo-1, completed 60.0 % of epochs #metrics {"StartTime": 1616443728.993254, "EndTime": 1616443741.906989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4070649.0, "count": 1, "min": 4070649, "max": 4070649}, "Total Batches Seen": {"sum": 4071.0, "count": 1, "min": 4071, "max": 4071}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:09:01 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=34920.66450326528 records/second [2021-03-22 20:09:13.883] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 21, "duration": 11972, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443753.8836632, "EndTime": 1616443753.883751, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1548859964328342, "count": 1, "min": 0.1548859964328342, "max": 0.1548859964328342}}} #metrics {"StartTime": 1616443753.883835, "EndTime": 1616443753.8838518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14132234732733834, "count": 1, "min": 0.14132234732733834, "max": 0.14132234732733834}}} #metrics {"StartTime": 1616443753.8839006, "EndTime": 1616443753.8839111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1566495677524143, "count": 1, "min": 0.1566495677524143, "max": 0.1566495677524143}}} #metrics {"StartTime": 1616443753.88395, "EndTime": 1616443753.8839602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159552508884007, "count": 1, "min": 0.14159552508884007, "max": 0.14159552508884007}}} #metrics {"StartTime": 1616443753.8840015, "EndTime": 1616443753.8840122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13847898717244467, "count": 1, "min": 0.13847898717244467, "max": 0.13847898717244467}}} #metrics {"StartTime": 1616443753.8840559, "EndTime": 1616443753.8840666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.141225740492079, "count": 1, "min": 0.141225740492079, "max": 0.141225740492079}}} #metrics {"StartTime": 1616443753.8841307, "EndTime": 1616443753.8841426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384776458231608, "count": 1, "min": 0.1384776458231608, "max": 0.1384776458231608}}} #metrics {"StartTime": 1616443753.8841884, "EndTime": 1616443753.8841994, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14122567915174697, "count": 1, "min": 0.14122567915174697, "max": 0.14122567915174697}}} #metrics {"StartTime": 1616443753.8842375, "EndTime": 1616443753.884248, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17479460015190973, "count": 1, "min": 0.17479460015190973, "max": 0.17479460015190973}}} #metrics {"StartTime": 1616443753.8842845, "EndTime": 1616443753.8842938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733730800713433, "count": 1, "min": 0.1733730800713433, "max": 0.1733730800713433}}} #metrics {"StartTime": 1616443753.8843315, "EndTime": 1616443753.8843415, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1744185712009006, "count": 1, "min": 0.1744185712009006, "max": 0.1744185712009006}}} #metrics {"StartTime": 1616443753.8843782, "EndTime": 1616443753.8843868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337383314344618, "count": 1, "min": 0.17337383314344618, "max": 0.17337383314344618}}} #metrics {"StartTime": 1616443753.8844244, "EndTime": 1616443753.8844342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17328997382269964, "count": 1, "min": 0.17328997382269964, "max": 0.17328997382269964}}} #metrics {"StartTime": 1616443753.8844717, "EndTime": 1616443753.8844812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520598663330078, "count": 1, "min": 0.17520598663330078, "max": 0.17520598663330078}}} #metrics {"StartTime": 1616443753.8845186, "EndTime": 1616443753.8845294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17328982611762153, "count": 1, "min": 0.17328982611762153, "max": 0.17328982611762153}}} #metrics {"StartTime": 1616443753.8845673, "EndTime": 1616443753.884578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520685011121961, "count": 1, "min": 0.17520685011121961, "max": 0.17520685011121961}}} #metrics {"StartTime": 1616443753.8846145, "EndTime": 1616443753.884625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476799568684896, "count": 1, "min": 0.4476799568684896, "max": 0.4476799568684896}}} #metrics {"StartTime": 1616443753.8846648, "EndTime": 1616443753.884675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477800248887804, "count": 1, "min": 0.4477800248887804, "max": 0.4477800248887804}}} #metrics {"StartTime": 1616443753.8847127, "EndTime": 1616443753.8847234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767949551052516, "count": 1, "min": 0.44767949551052516, "max": 0.44767949551052516}}} #metrics {"StartTime": 1616443753.8847628, "EndTime": 1616443753.884773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477800236002604, "count": 1, "min": 0.4477800236002604, "max": 0.4477800236002604}}} #metrics {"StartTime": 1616443753.8848112, "EndTime": 1616443753.8848214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477208672417535, "count": 1, "min": 0.4477208672417535, "max": 0.4477208672417535}}} #metrics {"StartTime": 1616443753.8848562, "EndTime": 1616443753.8848665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44879194023980035, "count": 1, "min": 0.44879194023980035, "max": 0.44879194023980035}}} #metrics {"StartTime": 1616443753.8848965, "EndTime": 1616443753.8849068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477208232286241, "count": 1, "min": 0.4477208232286241, "max": 0.4477208232286241}}} #metrics {"StartTime": 1616443753.8849416, "EndTime": 1616443753.8849516, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44879190741644964, "count": 1, "min": 0.44879190741644964, "max": 0.44879190741644964}}} #metrics {"StartTime": 1616443753.8849902, "EndTime": 1616443753.885001, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847305657280816, "count": 1, "min": 0.6847305657280816, "max": 0.6847305657280816}}} #metrics {"StartTime": 1616443753.8850396, "EndTime": 1616443753.8850498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848417445203993, "count": 1, "min": 0.6848417445203993, "max": 0.6848417445203993}}} #metrics {"StartTime": 1616443753.8850923, "EndTime": 1616443753.8851035, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320235188802, "count": 1, "min": 0.6847320235188802, "max": 0.6847320235188802}}} #metrics {"StartTime": 1616443753.8851473, "EndTime": 1616443753.8851573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848415662977431, "count": 1, "min": 0.6848415662977431, "max": 0.6848415662977431}}} #metrics {"StartTime": 1616443753.885201, "EndTime": 1616443753.885212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847772037760417, "count": 1, "min": 0.6847772037760417, "max": 0.6847772037760417}}} #metrics {"StartTime": 1616443753.8852491, "EndTime": 1616443753.885258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863679409450955, "count": 1, "min": 0.6863679409450955, "max": 0.6863679409450955}}} #metrics {"StartTime": 1616443753.8852925, "EndTime": 1616443753.885302, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847766563585069, "count": 1, "min": 0.6847766563585069, "max": 0.6847766563585069}}} #metrics {"StartTime": 1616443753.8853383, "EndTime": 1616443753.8853476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863679892306858, "count": 1, "min": 0.6863679892306858, "max": 0.6863679892306858}}} [03/22/2021 20:09:13 INFO 140462947600192] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.1548859964328342 [2021-03-22 20:09:14.804] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 29, "duration": 904, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443755.4725995, "EndTime": 1616443755.4726622, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15581602665344746, "count": 1, "min": 0.15581602665344746, "max": 0.15581602665344746}}} #metrics {"StartTime": 1616443755.4727352, "EndTime": 1616443755.4727473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14249036192407585, "count": 1, "min": 0.14249036192407585, "max": 0.14249036192407585}}} #metrics {"StartTime": 1616443755.4727786, "EndTime": 1616443755.472786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1574054067008394, "count": 1, "min": 0.1574054067008394, "max": 0.1574054067008394}}} #metrics {"StartTime": 1616443755.4728172, "EndTime": 1616443755.4728253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14272688641834919, "count": 1, "min": 0.14272688641834919, "max": 0.14272688641834919}}} #metrics {"StartTime": 1616443755.4728632, "EndTime": 1616443755.4728725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14021104011041635, "count": 1, "min": 0.14021104011041635, "max": 0.14021104011041635}}} #metrics {"StartTime": 1616443755.4729023, "EndTime": 1616443755.4729123, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1420550275487597, "count": 1, "min": 0.1420550275487597, "max": 0.1420550275487597}}} #metrics {"StartTime": 1616443755.472946, "EndTime": 1616443755.472955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14021012402815833, "count": 1, "min": 0.14021012402815833, "max": 0.14021012402815833}}} #metrics {"StartTime": 1616443755.472991, "EndTime": 1616443755.473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1420543826977708, "count": 1, "min": 0.1420543826977708, "max": 0.1420543826977708}}} #metrics {"StartTime": 1616443755.4730382, "EndTime": 1616443755.473046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1756921888307115, "count": 1, "min": 0.1756921888307115, "max": 0.1756921888307115}}} #metrics {"StartTime": 1616443755.4730768, "EndTime": 1616443755.4730856, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17416632968482343, "count": 1, "min": 0.17416632968482343, "max": 0.17416632968482343}}} #metrics {"StartTime": 1616443755.473122, "EndTime": 1616443755.47313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17530722273819324, "count": 1, "min": 0.17530722273819324, "max": 0.17530722273819324}}} #metrics {"StartTime": 1616443755.4731636, "EndTime": 1616443755.4731727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17417362761958516, "count": 1, "min": 0.17417362761958516, "max": 0.17417362761958516}}} #metrics {"StartTime": 1616443755.4732096, "EndTime": 1616443755.4732192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743547209150427, "count": 1, "min": 0.1743547209150427, "max": 0.1743547209150427}}} #metrics {"StartTime": 1616443755.4732566, "EndTime": 1616443755.4732664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17534884888799726, "count": 1, "min": 0.17534884888799726, "max": 0.17534884888799726}}} #metrics {"StartTime": 1616443755.4733033, "EndTime": 1616443755.4733126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743533803233657, "count": 1, "min": 0.1743533803233657, "max": 0.1743533803233657}}} #metrics {"StartTime": 1616443755.4733458, "EndTime": 1616443755.473356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17532478536890397, "count": 1, "min": 0.17532478536890397, "max": 0.17532478536890397}}} #metrics {"StartTime": 1616443755.4733918, "EndTime": 1616443755.4734015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4488790309405906, "count": 1, "min": 0.4488790309405906, "max": 0.4488790309405906}}} #metrics {"StartTime": 1616443755.4734328, "EndTime": 1616443755.4734423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44982535737995055, "count": 1, "min": 0.44982535737995055, "max": 0.44982535737995055}}} #metrics {"StartTime": 1616443755.4734814, "EndTime": 1616443755.473492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44904410440236175, "count": 1, "min": 0.44904410440236175, "max": 0.44904410440236175}}} #metrics {"StartTime": 1616443755.4735236, "EndTime": 1616443755.4735305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498376093457222, "count": 1, "min": 0.4498376093457222, "max": 0.4498376093457222}}} #metrics {"StartTime": 1616443755.4735503, "EndTime": 1616443755.473555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494009860128254, "count": 1, "min": 0.4494009860128254, "max": 0.4494009860128254}}} #metrics {"StartTime": 1616443755.4735844, "EndTime": 1616443755.473593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501760242212447, "count": 1, "min": 0.4501760242212447, "max": 0.4501760242212447}}} #metrics {"StartTime": 1616443755.4736292, "EndTime": 1616443755.473638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44940244421925934, "count": 1, "min": 0.44940244421925934, "max": 0.44940244421925934}}} #metrics {"StartTime": 1616443755.4736705, "EndTime": 1616443755.4736788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501769126254615, "count": 1, "min": 0.4501769126254615, "max": 0.4501769126254615}}} #metrics {"StartTime": 1616443755.4737034, "EndTime": 1616443755.47371, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847849084063373, "count": 1, "min": 0.6847849084063373, "max": 0.6847849084063373}}} #metrics {"StartTime": 1616443755.4737396, "EndTime": 1616443755.473745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852065950711399, "count": 1, "min": 0.6852065950711399, "max": 0.6852065950711399}}} #metrics {"StartTime": 1616443755.4737802, "EndTime": 1616443755.4737892, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847711235237223, "count": 1, "min": 0.6847711235237223, "max": 0.6847711235237223}}} #metrics {"StartTime": 1616443755.4738178, "EndTime": 1616443755.473824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853439710020532, "count": 1, "min": 0.6853439710020532, "max": 0.6853439710020532}}} #metrics {"StartTime": 1616443755.4738576, "EndTime": 1616443755.4738657, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843205972874188, "count": 1, "min": 0.6843205972874188, "max": 0.6843205972874188}}} #metrics {"StartTime": 1616443755.4738984, "EndTime": 1616443755.4739046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402300439618, "count": 1, "min": 0.6837402300439618, "max": 0.6837402300439618}}} #metrics {"StartTime": 1616443755.473924, "EndTime": 1616443755.473929, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684382537089279, "count": 1, "min": 0.684382537089279, "max": 0.684382537089279}}} #metrics {"StartTime": 1616443755.4739525, "EndTime": 1616443755.4739583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402581957103, "count": 1, "min": 0.6837402581957103, "max": 0.6837402581957103}}} [03/22/2021 20:09:15 INFO 140462947600192] #quality_metric: host=algo-1, epoch=9, validation binary_classification_cross_entropy_objective <loss>=0.15581602665344746 [03/22/2021 20:09:15 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:09:15 INFO 140462947600192] Epoch 9: Loss improved. Updating best model [03/22/2021 20:09:15 INFO 140462947600192] Saving model for epoch: 9 [03/22/2021 20:09:15 INFO 140462947600192] Saved checkpoint to "/tmp/tmp2p7ru2uq/mx-mod-0000.params" [03/22/2021 20:09:15 INFO 140462947600192] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs #metrics {"StartTime": 1616443741.9108572, "EndTime": 1616443755.4798846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4521610.0, "count": 1, "min": 4521610, "max": 4521610}, "Total Batches Seen": {"sum": 4522.0, "count": 1, "min": 4522, "max": 4522}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:09:15 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=33234.213370335136 records/second [2021-03-22 20:09:26.528] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 23, "duration": 11046, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443766.5289738, "EndTime": 1616443766.5290596, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15461682049221462, "count": 1, "min": 0.15461682049221462, "max": 0.15461682049221462}}} #metrics {"StartTime": 1616443766.5291457, "EndTime": 1616443766.5291636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14076118842230903, "count": 1, "min": 0.14076118842230903, "max": 0.14076118842230903}}} #metrics {"StartTime": 1616443766.5292063, "EndTime": 1616443766.5292168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15611501790364582, "count": 1, "min": 0.15611501790364582, "max": 0.15611501790364582}}} #metrics {"StartTime": 1616443766.5292547, "EndTime": 1616443766.5292652, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1409902783372667, "count": 1, "min": 0.1409902783372667, "max": 0.1409902783372667}}} #metrics {"StartTime": 1616443766.5293055, "EndTime": 1616443766.5293167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384499378797743, "count": 1, "min": 0.1384499378797743, "max": 0.1384499378797743}}} #metrics {"StartTime": 1616443766.529357, "EndTime": 1616443766.529368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14113318871392144, "count": 1, "min": 0.14113318871392144, "max": 0.14113318871392144}}} #metrics {"StartTime": 1616443766.5294077, "EndTime": 1616443766.529418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384487392171224, "count": 1, "min": 0.1384487392171224, "max": 0.1384487392171224}}} #metrics {"StartTime": 1616443766.5294611, "EndTime": 1616443766.529473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1411331733025445, "count": 1, "min": 0.1411331733025445, "max": 0.1411331733025445}}} #metrics {"StartTime": 1616443766.5295177, "EndTime": 1616443766.5295286, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17467522603352864, "count": 1, "min": 0.17467522603352864, "max": 0.17467522603352864}}} #metrics {"StartTime": 1616443766.5295718, "EndTime": 1616443766.529582, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733687570868598, "count": 1, "min": 0.1733687570868598, "max": 0.1733687570868598}}} #metrics {"StartTime": 1616443766.5296202, "EndTime": 1616443766.5296302, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17425065592447916, "count": 1, "min": 0.17425065592447916, "max": 0.17425065592447916}}} #metrics {"StartTime": 1616443766.5296645, "EndTime": 1616443766.5296745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733694366455078, "count": 1, "min": 0.1733694366455078, "max": 0.1733694366455078}}} #metrics {"StartTime": 1616443766.5297124, "EndTime": 1616443766.5297227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17326278832329645, "count": 1, "min": 0.17326278832329645, "max": 0.17326278832329645}}} #metrics {"StartTime": 1616443766.5297616, "EndTime": 1616443766.529772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17517167890760635, "count": 1, "min": 0.17517167890760635, "max": 0.17517167890760635}}} #metrics {"StartTime": 1616443766.5298104, "EndTime": 1616443766.5298219, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17326268001980252, "count": 1, "min": 0.17326268001980252, "max": 0.17326268001980252}}} #metrics {"StartTime": 1616443766.5298662, "EndTime": 1616443766.5298772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17517204379611545, "count": 1, "min": 0.17517204379611545, "max": 0.17517204379611545}}} #metrics {"StartTime": 1616443766.5299194, "EndTime": 1616443766.529931, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767566602918835, "count": 1, "min": 0.44767566602918835, "max": 0.44767566602918835}}} #metrics {"StartTime": 1616443766.529975, "EndTime": 1616443766.5299861, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777454800075955, "count": 1, "min": 0.44777454800075955, "max": 0.44777454800075955}}} #metrics {"StartTime": 1616443766.530025, "EndTime": 1616443766.530036, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767947068956165, "count": 1, "min": 0.44767947068956165, "max": 0.44767947068956165}}} #metrics {"StartTime": 1616443766.5300734, "EndTime": 1616443766.5300834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477745378960504, "count": 1, "min": 0.4477745378960504, "max": 0.4477745378960504}}} #metrics {"StartTime": 1616443766.5301223, "EndTime": 1616443766.5301328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44771400465223526, "count": 1, "min": 0.44771400465223526, "max": 0.44771400465223526}}} #metrics {"StartTime": 1616443766.5301712, "EndTime": 1616443766.5301814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487335150824653, "count": 1, "min": 0.4487335150824653, "max": 0.4487335150824653}}} #metrics {"StartTime": 1616443766.5302205, "EndTime": 1616443766.530231, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447714028116862, "count": 1, "min": 0.447714028116862, "max": 0.447714028116862}}} #metrics {"StartTime": 1616443766.530275, "EndTime": 1616443766.5302868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487335040283203, "count": 1, "min": 0.4487335040283203, "max": 0.4487335040283203}}} #metrics {"StartTime": 1616443766.530339, "EndTime": 1616443766.5303507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847294428168402, "count": 1, "min": 0.6847294428168402, "max": 0.6847294428168402}}} #metrics {"StartTime": 1616443766.530393, "EndTime": 1616443766.5304039, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848382773166233, "count": 1, "min": 0.6848382773166233, "max": 0.6848382773166233}}} #metrics {"StartTime": 1616443766.5304484, "EndTime": 1616443766.53046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320263671876, "count": 1, "min": 0.6847320263671876, "max": 0.6847320263671876}}} #metrics {"StartTime": 1616443766.5305035, "EndTime": 1616443766.5305147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848382972547743, "count": 1, "min": 0.6848382972547743, "max": 0.6848382972547743}}} #metrics {"StartTime": 1616443766.5305521, "EndTime": 1616443766.5305617, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847614290364583, "count": 1, "min": 0.6847614290364583, "max": 0.6847614290364583}}} #metrics {"StartTime": 1616443766.5305989, "EndTime": 1616443766.5306094, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863115847439236, "count": 1, "min": 0.6863115847439236, "max": 0.6863115847439236}}} #metrics {"StartTime": 1616443766.530648, "EndTime": 1616443766.5306587, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847616257052951, "count": 1, "min": 0.6847616257052951, "max": 0.6847616257052951}}} #metrics {"StartTime": 1616443766.530697, "EndTime": 1616443766.5307083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863116212293837, "count": 1, "min": 0.6863116212293837, "max": 0.6863116212293837}}} [03/22/2021 20:09:26 INFO 140462947600192] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.15461682049221462 [2021-03-22 20:09:27.634] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 32, "duration": 1087, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443768.3081322, "EndTime": 1616443768.308195, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15560237477809927, "count": 1, "min": 0.15560237477809927, "max": 0.15560237477809927}}} #metrics {"StartTime": 1616443768.3082676, "EndTime": 1616443768.308278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1420236312435814, "count": 1, "min": 0.1420236312435814, "max": 0.1420236312435814}}} #metrics {"StartTime": 1616443768.3083105, "EndTime": 1616443768.3083196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1568745043803471, "count": 1, "min": 0.1568745043803471, "max": 0.1568745043803471}}} #metrics {"StartTime": 1616443768.3083494, "EndTime": 1616443768.3083572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.142220444312983, "count": 1, "min": 0.142220444312983, "max": 0.142220444312983}}} #metrics {"StartTime": 1616443768.3083928, "EndTime": 1616443768.3084016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14015598544123664, "count": 1, "min": 0.14015598544123664, "max": 0.14015598544123664}}} #metrics {"StartTime": 1616443768.3084345, "EndTime": 1616443768.308443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1417256045853265, "count": 1, "min": 0.1417256045853265, "max": 0.1417256045853265}}} #metrics {"StartTime": 1616443768.308475, "EndTime": 1616443768.3084826, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401550532529302, "count": 1, "min": 0.1401550532529302, "max": 0.1401550532529302}}} #metrics {"StartTime": 1616443768.308511, "EndTime": 1616443768.308519, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14172506895770792, "count": 1, "min": 0.14172506895770792, "max": 0.14172506895770792}}} #metrics {"StartTime": 1616443768.3085482, "EndTime": 1616443768.3085563, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1755940575199557, "count": 1, "min": 0.1755940575199557, "max": 0.1755940575199557}}} #metrics {"StartTime": 1616443768.3085892, "EndTime": 1616443768.3085976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17417739129180665, "count": 1, "min": 0.17417739129180665, "max": 0.17417739129180665}}} #metrics {"StartTime": 1616443768.3086293, "EndTime": 1616443768.3086374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751424228085553, "count": 1, "min": 0.1751424228085553, "max": 0.1751424228085553}}} #metrics {"StartTime": 1616443768.3086658, "EndTime": 1616443768.308674, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17418440723537618, "count": 1, "min": 0.17418440723537618, "max": 0.17418440723537618}}} #metrics {"StartTime": 1616443768.3087072, "EndTime": 1616443768.3087175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433640217979854, "count": 1, "min": 0.17433640217979854, "max": 0.17433640217979854}}} #metrics {"StartTime": 1616443768.3087525, "EndTime": 1616443768.3087616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17602177258393897, "count": 1, "min": 0.17602177258393897, "max": 0.17602177258393897}}} #metrics {"StartTime": 1616443768.3087893, "EndTime": 1616443768.3087993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433562942783692, "count": 1, "min": 0.17433562942783692, "max": 0.17433562942783692}}} #metrics {"StartTime": 1616443768.308835, "EndTime": 1616443768.3088443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1760062157653083, "count": 1, "min": 0.1760062157653083, "max": 0.1760062157653083}}} #metrics {"StartTime": 1616443768.3088748, "EndTime": 1616443768.3088834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4488336725185923, "count": 1, "min": 0.4488336725185923, "max": 0.4488336725185923}}} #metrics {"StartTime": 1616443768.3089166, "EndTime": 1616443768.308925, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44992522651979594, "count": 1, "min": 0.44992522651979594, "max": 0.44992522651979594}}} #metrics {"StartTime": 1616443768.3089514, "EndTime": 1616443768.3089602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490551926722991, "count": 1, "min": 0.4490551926722991, "max": 0.4490551926722991}}} #metrics {"StartTime": 1616443768.3089929, "EndTime": 1616443768.3090017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499346256848238, "count": 1, "min": 0.4499346256848238, "max": 0.4499346256848238}}} #metrics {"StartTime": 1616443768.3090339, "EndTime": 1616443768.3090427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493922381276714, "count": 1, "min": 0.4493922381276714, "max": 0.4493922381276714}}} #metrics {"StartTime": 1616443768.3090749, "EndTime": 1616443768.3090837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506329335958289, "count": 1, "min": 0.4506329335958289, "max": 0.4506329335958289}}} #metrics {"StartTime": 1616443768.3091168, "EndTime": 1616443768.309126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493911380439611, "count": 1, "min": 0.4493911380439611, "max": 0.4493911380439611}}} #metrics {"StartTime": 1616443768.3091516, "EndTime": 1616443768.30916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506332429943724, "count": 1, "min": 0.4506332429943724, "max": 0.4506332429943724}}} #metrics {"StartTime": 1616443768.3091946, "EndTime": 1616443768.3092043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847834328757505, "count": 1, "min": 0.6847834328757505, "max": 0.6847834328757505}}} #metrics {"StartTime": 1616443768.3092425, "EndTime": 1616443768.3092523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853917006674823, "count": 1, "min": 0.6853917006674823, "max": 0.6853917006674823}}} #metrics {"StartTime": 1616443768.3092885, "EndTime": 1616443768.309297, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847850984306396, "count": 1, "min": 0.6847850984306396, "max": 0.6847850984306396}}} #metrics {"StartTime": 1616443768.30933, "EndTime": 1616443768.3093386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855036550281275, "count": 1, "min": 0.6855036550281275, "max": 0.6855036550281275}}} #metrics {"StartTime": 1616443768.309377, "EndTime": 1616443768.3093867, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844979830788068, "count": 1, "min": 0.6844979830788068, "max": 0.6844979830788068}}} #metrics {"StartTime": 1616443768.3094196, "EndTime": 1616443768.3094285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848288873926596, "count": 1, "min": 0.6848288873926596, "max": 0.6848288873926596}}} #metrics {"StartTime": 1616443768.3094614, "EndTime": 1616443768.3094676, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845233250662476, "count": 1, "min": 0.6845233250662476, "max": 0.6845233250662476}}} #metrics {"StartTime": 1616443768.309496, "EndTime": 1616443768.3095014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848288700685067, "count": 1, "min": 0.6848288700685067, "max": 0.6848288700685067}}} [03/22/2021 20:09:28 INFO 140462947600192] #quality_metric: host=algo-1, epoch=10, validation binary_classification_cross_entropy_objective <loss>=0.15560237477809927 [03/22/2021 20:09:28 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:09:28 INFO 140462947600192] Epoch 10: Loss improved. Updating best model [03/22/2021 20:09:28 INFO 140462947600192] Saving model for epoch: 10 [03/22/2021 20:09:28 INFO 140462947600192] Saved checkpoint to "/tmp/tmp8jzgf2oq/mx-mod-0000.params" [03/22/2021 20:09:28 INFO 140462947600192] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs #metrics {"StartTime": 1616443755.4827635, "EndTime": 1616443768.3153772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4972571.0, "count": 1, "min": 4972571, "max": 4972571}, "Total Batches Seen": {"sum": 4973.0, "count": 1, "min": 4973, "max": 4973}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:09:28 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=35141.434880985726 records/second [2021-03-22 20:09:38.735] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 25, "duration": 10417, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443778.735367, "EndTime": 1616443778.735433, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15443607860989042, "count": 1, "min": 0.15443607860989042, "max": 0.15443607860989042}}} #metrics {"StartTime": 1616443778.7355106, "EndTime": 1616443778.7355273, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14031785756429035, "count": 1, "min": 0.14031785756429035, "max": 0.14031785756429035}}} #metrics {"StartTime": 1616443778.7355733, "EndTime": 1616443778.735584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15556795852661132, "count": 1, "min": 0.15556795852661132, "max": 0.15556795852661132}}} #metrics {"StartTime": 1616443778.7356234, "EndTime": 1616443778.7356334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1405059410434299, "count": 1, "min": 0.1405059410434299, "max": 0.1405059410434299}}} #metrics {"StartTime": 1616443778.7356741, "EndTime": 1616443778.735684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13842714664035374, "count": 1, "min": 0.13842714664035374, "max": 0.13842714664035374}}} #metrics {"StartTime": 1616443778.735723, "EndTime": 1616443778.735733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102241214328343, "count": 1, "min": 0.14102241214328343, "max": 0.14102241214328343}}} #metrics {"StartTime": 1616443778.7357779, "EndTime": 1616443778.7357888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13842593878851997, "count": 1, "min": 0.13842593878851997, "max": 0.13842593878851997}}} #metrics {"StartTime": 1616443778.7358322, "EndTime": 1616443778.7358434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102239520602755, "count": 1, "min": 0.14102239520602755, "max": 0.14102239520602755}}} #metrics {"StartTime": 1616443778.7358885, "EndTime": 1616443778.735899, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17459287611219618, "count": 1, "min": 0.17459287611219618, "max": 0.17459287611219618}}} #metrics {"StartTime": 1616443778.7359428, "EndTime": 1616443778.7359536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733639575873481, "count": 1, "min": 0.1733639575873481, "max": 0.1733639575873481}}} #metrics {"StartTime": 1616443778.7359908, "EndTime": 1616443778.7360013, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17408617733425563, "count": 1, "min": 0.17408617733425563, "max": 0.17408617733425563}}} #metrics {"StartTime": 1616443778.7360396, "EndTime": 1616443778.7360492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336453070746527, "count": 1, "min": 0.17336453070746527, "max": 0.17336453070746527}}} #metrics {"StartTime": 1616443778.736103, "EndTime": 1616443778.7361145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17324363861083986, "count": 1, "min": 0.17324363861083986, "max": 0.17324363861083986}}} #metrics {"StartTime": 1616443778.7361538, "EndTime": 1616443778.7361634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514980207655165, "count": 1, "min": 0.17514980207655165, "max": 0.17514980207655165}}} #metrics {"StartTime": 1616443778.7361999, "EndTime": 1616443778.736209, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732435777452257, "count": 1, "min": 0.1732435777452257, "max": 0.1732435777452257}}} #metrics {"StartTime": 1616443778.7362437, "EndTime": 1616443778.7362537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1751499444580078, "count": 1, "min": 0.1751499444580078, "max": 0.1751499444580078}}} #metrics {"StartTime": 1616443778.7362914, "EndTime": 1616443778.7363005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767094231499566, "count": 1, "min": 0.44767094231499566, "max": 0.44767094231499566}}} #metrics {"StartTime": 1616443778.7363384, "EndTime": 1616443778.7363489, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477706766764323, "count": 1, "min": 0.4477706766764323, "max": 0.4477706766764323}}} #metrics {"StartTime": 1616443778.7363791, "EndTime": 1616443778.7363875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767950039333765, "count": 1, "min": 0.44767950039333765, "max": 0.44767950039333765}}} #metrics {"StartTime": 1616443778.7364266, "EndTime": 1616443778.7364373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777066514756947, "count": 1, "min": 0.44777066514756947, "max": 0.44777066514756947}}} #metrics {"StartTime": 1616443778.736477, "EndTime": 1616443778.736489, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768827175564235, "count": 1, "min": 0.44768827175564235, "max": 0.44768827175564235}}} #metrics {"StartTime": 1616443778.7365265, "EndTime": 1616443778.7365365, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448679133843316, "count": 1, "min": 0.448679133843316, "max": 0.448679133843316}}} #metrics {"StartTime": 1616443778.7365744, "EndTime": 1616443778.7365851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476882918972439, "count": 1, "min": 0.4476882918972439, "max": 0.4476882918972439}}} #metrics {"StartTime": 1616443778.7366223, "EndTime": 1616443778.7366333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486791297064887, "count": 1, "min": 0.4486791297064887, "max": 0.4486791297064887}}} #metrics {"StartTime": 1616443778.7366738, "EndTime": 1616443778.7366846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847284864637587, "count": 1, "min": 0.6847284864637587, "max": 0.6847284864637587}}} #metrics {"StartTime": 1616443778.736724, "EndTime": 1616443778.736732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848348377821181, "count": 1, "min": 0.6848348377821181, "max": 0.6848348377821181}}} #metrics {"StartTime": 1616443778.7367666, "EndTime": 1616443778.7367766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320674641927, "count": 1, "min": 0.6847320674641927, "max": 0.6847320674641927}}} #metrics {"StartTime": 1616443778.7368138, "EndTime": 1616443778.7368245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848352307128907, "count": 1, "min": 0.6848352307128907, "max": 0.6848352307128907}}} #metrics {"StartTime": 1616443778.7368708, "EndTime": 1616443778.736882, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847499206542969, "count": 1, "min": 0.6847499206542969, "max": 0.6847499206542969}}} #metrics {"StartTime": 1616443778.7369246, "EndTime": 1616443778.7369356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657495117187, "count": 1, "min": 0.6862657495117187, "max": 0.6862657495117187}}} #metrics {"StartTime": 1616443778.7369757, "EndTime": 1616443778.7369857, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847497003851997, "count": 1, "min": 0.6847497003851997, "max": 0.6847497003851997}}} #metrics {"StartTime": 1616443778.73702, "EndTime": 1616443778.7370296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657664659289, "count": 1, "min": 0.6862657664659289, "max": 0.6862657664659289}}} [03/22/2021 20:09:38 INFO 140462947600192] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.15443607860989042 [2021-03-22 20:09:39.893] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 35, "duration": 1140, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443780.5421858, "EndTime": 1616443780.5422523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15545973934263588, "count": 1, "min": 0.15545973934263588, "max": 0.15545973934263588}}} #metrics {"StartTime": 1616443780.5423243, "EndTime": 1616443780.5423348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1416547745831029, "count": 1, "min": 0.1416547745831029, "max": 0.1416547745831029}}} #metrics {"StartTime": 1616443780.5423675, "EndTime": 1616443780.542374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1563369823386108, "count": 1, "min": 0.1563369823386108, "max": 0.1563369823386108}}} #metrics {"StartTime": 1616443780.5424006, "EndTime": 1616443780.5424078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1418176771119615, "count": 1, "min": 0.1418176771119615, "max": 0.1418176771119615}}} #metrics {"StartTime": 1616443780.542445, "EndTime": 1616443780.5424547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401278294293788, "count": 1, "min": 0.1401278294293788, "max": 0.1401278294293788}}} #metrics {"StartTime": 1616443780.5424874, "EndTime": 1616443780.5424964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414400008335083, "count": 1, "min": 0.1414400008335083, "max": 0.1414400008335083}}} #metrics {"StartTime": 1616443780.5425267, "EndTime": 1616443780.5425346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14012671770600324, "count": 1, "min": 0.14012671770600324, "max": 0.14012671770600324}}} #metrics {"StartTime": 1616443780.5425725, "EndTime": 1616443780.5425823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14143969441255358, "count": 1, "min": 0.14143969441255358, "max": 0.14143969441255358}}} #metrics {"StartTime": 1616443780.5426166, "EndTime": 1616443780.542625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1755262911182273, "count": 1, "min": 0.1755262911182273, "max": 0.1755262911182273}}} #metrics {"StartTime": 1616443780.5426533, "EndTime": 1616443780.5426612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17419045302638225, "count": 1, "min": 0.17419045302638225, "max": 0.17419045302638225}}} #metrics {"StartTime": 1616443780.5426934, "EndTime": 1616443780.5427017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17498462224273112, "count": 1, "min": 0.17498462224273112, "max": 0.17498462224273112}}} #metrics {"StartTime": 1616443780.542738, "EndTime": 1616443780.5427475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17419671530162736, "count": 1, "min": 0.17419671530162736, "max": 0.17419671530162736}}} #metrics {"StartTime": 1616443780.542774, "EndTime": 1616443780.5427828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427781798515163, "count": 1, "min": 0.17427781798515163, "max": 0.17427781798515163}}} #metrics {"StartTime": 1616443780.5428123, "EndTime": 1616443780.5428214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17655364262078574, "count": 1, "min": 0.17655364262078574, "max": 0.17655364262078574}}} #metrics {"StartTime": 1616443780.5428536, "EndTime": 1616443780.5428622, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427748672839954, "count": 1, "min": 0.17427748672839954, "max": 0.17427748672839954}}} #metrics {"StartTime": 1616443780.5428925, "EndTime": 1616443780.5429015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.176547012477981, "count": 1, "min": 0.176547012477981, "max": 0.176547012477981}}} #metrics {"StartTime": 1616443780.5429337, "EndTime": 1616443780.5429566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4488074350889976, "count": 1, "min": 0.4488074350889976, "max": 0.4488074350889976}}} #metrics {"StartTime": 1616443780.542991, "EndTime": 1616443780.5429997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500131019320242, "count": 1, "min": 0.4500131019320242, "max": 0.4500131019320242}}} #metrics {"StartTime": 1616443780.5430348, "EndTime": 1616443780.5430446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44906297500661785, "count": 1, "min": 0.44906297500661785, "max": 0.44906297500661785}}} #metrics {"StartTime": 1616443780.5430787, "EndTime": 1616443780.5430882, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45001991736205815, "count": 1, "min": 0.45001991736205815, "max": 0.45001991736205815}}} #metrics {"StartTime": 1616443780.5431292, "EndTime": 1616443780.5431387, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498080435132481, "count": 1, "min": 0.4498080435132481, "max": 0.4498080435132481}}} #metrics {"StartTime": 1616443780.5431714, "EndTime": 1616443780.5431805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4508171621569298, "count": 1, "min": 0.4508171621569298, "max": 0.4508171621569298}}} #metrics {"StartTime": 1616443780.5432117, "EndTime": 1616443780.5432215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498077906888915, "count": 1, "min": 0.4498077906888915, "max": 0.4498077906888915}}} #metrics {"StartTime": 1616443780.543252, "EndTime": 1616443780.5432615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4508172582518405, "count": 1, "min": 0.4508172582518405, "max": 0.4508172582518405}}} #metrics {"StartTime": 1616443780.543288, "EndTime": 1616443780.5432966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847868703666553, "count": 1, "min": 0.6847868703666553, "max": 0.6847868703666553}}} #metrics {"StartTime": 1616443780.5433228, "EndTime": 1616443780.5433316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854908042963206, "count": 1, "min": 0.6854908042963206, "max": 0.6854908042963206}}} #metrics {"StartTime": 1616443780.5433571, "EndTime": 1616443780.543366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848020003073305, "count": 1, "min": 0.6848020003073305, "max": 0.6848020003073305}}} #metrics {"StartTime": 1616443780.5433967, "EndTime": 1616443780.5434055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856148192449857, "count": 1, "min": 0.6856148192449857, "max": 0.6856148192449857}}} #metrics {"StartTime": 1616443780.5434365, "EndTime": 1616443780.5434453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845315231802364, "count": 1, "min": 0.6845315231802364, "max": 0.6845315231802364}}} #metrics {"StartTime": 1616443780.5434768, "EndTime": 1616443780.5434854, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849504033322662, "count": 1, "min": 0.6849504033322662, "max": 0.6849504033322662}}} #metrics {"StartTime": 1616443780.5435119, "EndTime": 1616443780.5435202, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845795441079863, "count": 1, "min": 0.6845795441079863, "max": 0.6845795441079863}}} #metrics {"StartTime": 1616443780.5435448, "EndTime": 1616443780.5435536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849503981891583, "count": 1, "min": 0.6849503981891583, "max": 0.6849503981891583}}} [03/22/2021 20:09:40 INFO 140462947600192] #quality_metric: host=algo-1, epoch=11, validation binary_classification_cross_entropy_objective <loss>=0.15545973934263588 [03/22/2021 20:09:40 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:09:40 INFO 140462947600192] Epoch 11: Loss improved. Updating best model [03/22/2021 20:09:40 INFO 140462947600192] Saving model for epoch: 11 [03/22/2021 20:09:40 INFO 140462947600192] Saved checkpoint to "/tmp/tmp66ige4qi/mx-mod-0000.params" [03/22/2021 20:09:40 INFO 140462947600192] #progress_metric: host=algo-1, completed 80.0 % of epochs #metrics {"StartTime": 1616443768.3181922, "EndTime": 1616443780.5488358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5423532.0, "count": 1, "min": 5423532, "max": 5423532}, "Total Batches Seen": {"sum": 5424.0, "count": 1, "min": 5424, "max": 5424}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:09:40 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=36871.04765932274 records/second [2021-03-22 20:09:51.614] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 27, "duration": 11062, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443791.6140575, "EndTime": 1616443791.6141438, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1543158437262641, "count": 1, "min": 0.1543158437262641, "max": 0.1543158437262641}}} #metrics {"StartTime": 1616443791.6142313, "EndTime": 1616443791.6142485, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13996640808105468, "count": 1, "min": 0.13996640808105468, "max": 0.13996640808105468}}} #metrics {"StartTime": 1616443791.6142936, "EndTime": 1616443791.614304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1550187636481391, "count": 1, "min": 0.1550187636481391, "max": 0.1550187636481391}}} #metrics {"StartTime": 1616443791.6143425, "EndTime": 1616443791.614352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1401216123284234, "count": 1, "min": 0.1401216123284234, "max": 0.1401216123284234}}} #metrics {"StartTime": 1616443791.6143944, "EndTime": 1616443791.6144059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13841161214192707, "count": 1, "min": 0.13841161214192707, "max": 0.13841161214192707}}} #metrics {"StartTime": 1616443791.6144464, "EndTime": 1616443791.6144545, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091815163506402, "count": 1, "min": 0.14091815163506402, "max": 0.14091815163506402}}} #metrics {"StartTime": 1616443791.614486, "EndTime": 1616443791.6144927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384104788208008, "count": 1, "min": 0.1384104788208008, "max": 0.1384104788208008}}} #metrics {"StartTime": 1616443791.6145298, "EndTime": 1616443791.6145406, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091812908596463, "count": 1, "min": 0.14091812908596463, "max": 0.14091812908596463}}} #metrics {"StartTime": 1616443791.6145835, "EndTime": 1616443791.6145945, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17453608103434246, "count": 1, "min": 0.17453608103434246, "max": 0.17453608103434246}}} #metrics {"StartTime": 1616443791.6146374, "EndTime": 1616443791.6146474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335877149793838, "count": 1, "min": 0.17335877149793838, "max": 0.17335877149793838}}} #metrics {"StartTime": 1616443791.6146863, "EndTime": 1616443791.614696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17393236165364584, "count": 1, "min": 0.17393236165364584, "max": 0.17393236165364584}}} #metrics {"StartTime": 1616443791.6147342, "EndTime": 1616443791.6147454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335952039930555, "count": 1, "min": 0.17335952039930555, "max": 0.17335952039930555}}} #metrics {"StartTime": 1616443791.6147878, "EndTime": 1616443791.6147988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17322929002549914, "count": 1, "min": 0.17322929002549914, "max": 0.17322929002549914}}} #metrics {"StartTime": 1616443791.614842, "EndTime": 1616443791.6148534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510965694851346, "count": 1, "min": 0.17510965694851346, "max": 0.17510965694851346}}} #metrics {"StartTime": 1616443791.614899, "EndTime": 1616443791.6149096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732292482164171, "count": 1, "min": 0.1732292482164171, "max": 0.1732292482164171}}} #metrics {"StartTime": 1616443791.6149535, "EndTime": 1616443791.6149635, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510990156385633, "count": 1, "min": 0.17510990156385633, "max": 0.17510990156385633}}} #metrics {"StartTime": 1616443791.6150084, "EndTime": 1616443791.6150193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476702324083116, "count": 1, "min": 0.4476702324083116, "max": 0.4476702324083116}}} #metrics {"StartTime": 1616443791.6150591, "EndTime": 1616443791.6150696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654580349392, "count": 1, "min": 0.4477654580349392, "max": 0.4477654580349392}}} #metrics {"StartTime": 1616443791.615111, "EndTime": 1616443791.6151211, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795245361328, "count": 1, "min": 0.4476795245361328, "max": 0.4476795245361328}}} #metrics {"StartTime": 1616443791.6151633, "EndTime": 1616443791.615174, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654507785373, "count": 1, "min": 0.4477654507785373, "max": 0.4477654507785373}}} #metrics {"StartTime": 1616443791.6152143, "EndTime": 1616443791.6152241, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767960035536025, "count": 1, "min": 0.44767960035536025, "max": 0.44767960035536025}}} #metrics {"StartTime": 1616443791.6152608, "EndTime": 1616443791.61527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44864054545084636, "count": 1, "min": 0.44864054545084636, "max": 0.44864054545084636}}} #metrics {"StartTime": 1616443791.615312, "EndTime": 1616443791.6153224, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795887586806, "count": 1, "min": 0.4476795887586806, "max": 0.4476795887586806}}} #metrics {"StartTime": 1616443791.6153624, "EndTime": 1616443791.615373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44864054328070746, "count": 1, "min": 0.44864054328070746, "max": 0.44864054328070746}}} #metrics {"StartTime": 1616443791.615415, "EndTime": 1616443791.6154249, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847279059516059, "count": 1, "min": 0.6847279059516059, "max": 0.6847279059516059}}} #metrics {"StartTime": 1616443791.6154625, "EndTime": 1616443791.6154735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848310276963976, "count": 1, "min": 0.6848310276963976, "max": 0.6848310276963976}}} #metrics {"StartTime": 1616443791.6155136, "EndTime": 1616443791.6155243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321385362414, "count": 1, "min": 0.6847321385362414, "max": 0.6847321385362414}}} #metrics {"StartTime": 1616443791.6155658, "EndTime": 1616443791.6155763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848313469780816, "count": 1, "min": 0.6848313469780816, "max": 0.6848313469780816}}} #metrics {"StartTime": 1616443791.6156206, "EndTime": 1616443791.6156313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847416532389323, "count": 1, "min": 0.6847416532389323, "max": 0.6847416532389323}}} #metrics {"StartTime": 1616443791.6156716, "EndTime": 1616443791.6156824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862042361111111, "count": 1, "min": 0.6862042361111111, "max": 0.6862042361111111}}} #metrics {"StartTime": 1616443791.6157262, "EndTime": 1616443791.6157372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847413395182291, "count": 1, "min": 0.6847413395182291, "max": 0.6847413395182291}}} #metrics {"StartTime": 1616443791.6157777, "EndTime": 1616443791.6157887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862042437065973, "count": 1, "min": 0.6862042437065973, "max": 0.6862042437065973}}} [03/22/2021 20:09:51 INFO 140462947600192] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.1543158437262641 [2021-03-22 20:09:52.752] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 38, "duration": 1120, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443793.4291077, "EndTime": 1616443793.4291754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15536527689496782, "count": 1, "min": 0.15536527689496782, "max": 0.15536527689496782}}} #metrics {"StartTime": 1616443793.4292474, "EndTime": 1616443793.429259, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14136650507725446, "count": 1, "min": 0.14136650507725446, "max": 0.14136650507725446}}} #metrics {"StartTime": 1616443793.42929, "EndTime": 1616443793.4292982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15580257248620477, "count": 1, "min": 0.15580257248620477, "max": 0.15580257248620477}}} #metrics {"StartTime": 1616443793.4293282, "EndTime": 1616443793.429336, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1415008224154356, "count": 1, "min": 0.1415008224154356, "max": 0.1415008224154356}}} #metrics {"StartTime": 1616443793.429371, "EndTime": 1616443793.4293804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.140114178538259, "count": 1, "min": 0.140114178538259, "max": 0.140114178538259}}} #metrics {"StartTime": 1616443793.4294116, "EndTime": 1616443793.4294202, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113160810594083, "count": 1, "min": 0.14113160810594083, "max": 0.14113160810594083}}} #metrics {"StartTime": 1616443793.4294477, "EndTime": 1616443793.4294567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14011322408570917, "count": 1, "min": 0.14011322408570917, "max": 0.14011322408570917}}} #metrics {"StartTime": 1616443793.4294853, "EndTime": 1616443793.4294949, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113149996533003, "count": 1, "min": 0.14113149996533003, "max": 0.14113149996533003}}} #metrics {"StartTime": 1616443793.429523, "EndTime": 1616443793.429532, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17547974084864615, "count": 1, "min": 0.17547974084864615, "max": 0.17547974084864615}}} #metrics {"StartTime": 1616443793.4295619, "EndTime": 1616443793.4295707, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420016348478282, "count": 1, "min": 0.17420016348478282, "max": 0.17420016348478282}}} #metrics {"StartTime": 1616443793.4296012, "EndTime": 1616443793.4296095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174840268873885, "count": 1, "min": 0.174840268873885, "max": 0.174840268873885}}} #metrics {"StartTime": 1616443793.4296417, "EndTime": 1616443793.4296508, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742052249120063, "count": 1, "min": 0.1742052249120063, "max": 0.1742052249120063}}} #metrics {"StartTime": 1616443793.4296837, "EndTime": 1616443793.4296927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17423933102599437, "count": 1, "min": 0.17423933102599437, "max": 0.17423933102599437}}} #metrics {"StartTime": 1616443793.4297256, "EndTime": 1616443793.4297345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659002564277804, "count": 1, "min": 0.17659002564277804, "max": 0.17659002564277804}}} #metrics {"StartTime": 1616443793.4297674, "EndTime": 1616443793.429776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742391853948339, "count": 1, "min": 0.1742391853948339, "max": 0.1742391853948339}}} #metrics {"StartTime": 1616443793.4298108, "EndTime": 1616443793.4298193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659058759498833, "count": 1, "min": 0.17659058759498833, "max": 0.17659058759498833}}} #metrics {"StartTime": 1616443793.4298515, "EndTime": 1616443793.4298604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487823356396978, "count": 1, "min": 0.4487823356396978, "max": 0.4487823356396978}}} #metrics {"StartTime": 1616443793.4298937, "EndTime": 1616443793.4299023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501426955286188, "count": 1, "min": 0.4501426955286188, "max": 0.4501426955286188}}} #metrics {"StartTime": 1616443793.4299235, "EndTime": 1616443793.429929, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44906828350603784, "count": 1, "min": 0.44906828350603784, "max": 0.44906828350603784}}} #metrics {"StartTime": 1616443793.4299476, "EndTime": 1616443793.4299526, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45014732459641654, "count": 1, "min": 0.45014732459641654, "max": 0.45014732459641654}}} #metrics {"StartTime": 1616443793.4299784, "EndTime": 1616443793.429985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44965558068135203, "count": 1, "min": 0.44965558068135203, "max": 0.44965558068135203}}} #metrics {"StartTime": 1616443793.4300175, "EndTime": 1616443793.4300237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4507006380095726, "count": 1, "min": 0.4507006380095726, "max": 0.4507006380095726}}} #metrics {"StartTime": 1616443793.4300554, "EndTime": 1616443793.4300647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496558751919516, "count": 1, "min": 0.4496558751919516, "max": 0.4496558751919516}}} #metrics {"StartTime": 1616443793.430097, "EndTime": 1616443793.4301066, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.450700637197503, "count": 1, "min": 0.450700637197503, "max": 0.450700637197503}}} #metrics {"StartTime": 1616443793.430138, "EndTime": 1616443793.430147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684783810758836, "count": 1, "min": 0.684783810758836, "max": 0.684783810758836}}} #metrics {"StartTime": 1616443793.430168, "EndTime": 1616443793.4301732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856185141619753, "count": 1, "min": 0.6856185141619753, "max": 0.6856185141619753}}} #metrics {"StartTime": 1616443793.4301913, "EndTime": 1616443793.4301982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174374810301, "count": 1, "min": 0.6848174374810301, "max": 0.6848174374810301}}} #metrics {"StartTime": 1616443793.4302318, "EndTime": 1616443793.4302397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857288738884824, "count": 1, "min": 0.6857288738884824, "max": 0.6857288738884824}}} #metrics {"StartTime": 1616443793.4302735, "EndTime": 1616443793.430283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846795342462122, "count": 1, "min": 0.6846795342462122, "max": 0.6846795342462122}}} #metrics {"StartTime": 1616443793.430316, "EndTime": 1616443793.4303248, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053046123132, "count": 1, "min": 0.6855053046123132, "max": 0.6855053046123132}}} #metrics {"StartTime": 1616443793.430358, "EndTime": 1616443793.4303668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847120367932958, "count": 1, "min": 0.6847120367932958, "max": 0.6847120367932958}}} #metrics {"StartTime": 1616443793.4304, "EndTime": 1616443793.4304082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053051536929, "count": 1, "min": 0.6855053051536929, "max": 0.6855053051536929}}} [03/22/2021 20:09:53 INFO 140462947600192] #quality_metric: host=algo-1, epoch=12, validation binary_classification_cross_entropy_objective <loss>=0.15536527689496782 [03/22/2021 20:09:53 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=sampled_accuracy, value=0.9505588078765301 [03/22/2021 20:09:53 INFO 140462947600192] Epoch 12: Loss improved. Updating best model [03/22/2021 20:09:53 INFO 140462947600192] Saving model for epoch: 12 [03/22/2021 20:09:53 INFO 140462947600192] Saved checkpoint to "/tmp/tmpv0bp8hv6/mx-mod-0000.params" [03/22/2021 20:09:53 INFO 140462947600192] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs #metrics {"StartTime": 1616443780.5515194, "EndTime": 1616443793.4355607, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5874493.0, "count": 1, "min": 5874493, "max": 5874493}, "Total Batches Seen": {"sum": 5875.0, "count": 1, "min": 5875, "max": 5875}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:09:53 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=35001.20227713238 records/second [2021-03-22 20:10:04.669] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 29, "duration": 11231, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443804.6694956, "EndTime": 1616443804.6695752, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15423655078464085, "count": 1, "min": 0.15423655078464085, "max": 0.15423655078464085}}} #metrics {"StartTime": 1616443804.669657, "EndTime": 1616443804.6696727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1396803460354275, "count": 1, "min": 0.1396803460354275, "max": 0.1396803460354275}}} #metrics {"StartTime": 1616443804.6697152, "EndTime": 1616443804.6697254, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15447604368421766, "count": 1, "min": 0.15447604368421766, "max": 0.15447604368421766}}} #metrics {"StartTime": 1616443804.6697657, "EndTime": 1616443804.6697764, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13980974093967014, "count": 1, "min": 0.13980974093967014, "max": 0.13980974093967014}}} #metrics {"StartTime": 1616443804.669812, "EndTime": 1616443804.6698215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13840109237670897, "count": 1, "min": 0.13840109237670897, "max": 0.13840109237670897}}} #metrics {"StartTime": 1616443804.6698592, "EndTime": 1616443804.6698697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14080574839274088, "count": 1, "min": 0.14080574839274088, "max": 0.14080574839274088}}} #metrics {"StartTime": 1616443804.669908, "EndTime": 1616443804.6699176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1383999422370063, "count": 1, "min": 0.1383999422370063, "max": 0.1383999422370063}}} #metrics {"StartTime": 1616443804.669954, "EndTime": 1616443804.6699655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14080573840671115, "count": 1, "min": 0.14080573840671115, "max": 0.14080573840671115}}} #metrics {"StartTime": 1616443804.670003, "EndTime": 1616443804.6700132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1744970681084527, "count": 1, "min": 0.1744970681084527, "max": 0.1744970681084527}}} #metrics {"StartTime": 1616443804.6700504, "EndTime": 1616443804.6700606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335341759575737, "count": 1, "min": 0.17335341759575737, "max": 0.17335341759575737}}} #metrics {"StartTime": 1616443804.6701, "EndTime": 1616443804.6701107, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17379407636854383, "count": 1, "min": 0.17379407636854383, "max": 0.17379407636854383}}} #metrics {"StartTime": 1616443804.6701531, "EndTime": 1616443804.6701636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335373711480034, "count": 1, "min": 0.17335373711480034, "max": 0.17335373711480034}}} #metrics {"StartTime": 1616443804.670201, "EndTime": 1616443804.670212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321976457383897, "count": 1, "min": 0.17321976457383897, "max": 0.17321976457383897}}} #metrics {"StartTime": 1616443804.67025, "EndTime": 1616443804.6702604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505044219970703, "count": 1, "min": 0.17505044219970703, "max": 0.17505044219970703}}} #metrics {"StartTime": 1616443804.6703024, "EndTime": 1616443804.6703131, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321975884331597, "count": 1, "min": 0.17321975884331597, "max": 0.17321975884331597}}} #metrics {"StartTime": 1616443804.670352, "EndTime": 1616443804.670362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505075439453124, "count": 1, "min": 0.17505075439453124, "max": 0.17505075439453124}}} #metrics {"StartTime": 1616443804.6704013, "EndTime": 1616443804.6704113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476710396999783, "count": 1, "min": 0.4476710396999783, "max": 0.4476710396999783}}} #metrics {"StartTime": 1616443804.6704519, "EndTime": 1616443804.6704624, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477618734402127, "count": 1, "min": 0.4477618734402127, "max": 0.4477618734402127}}} #metrics {"StartTime": 1616443804.6705005, "EndTime": 1616443804.6705117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767953721788195, "count": 1, "min": 0.44767953721788195, "max": 0.44767953721788195}}} #metrics {"StartTime": 1616443804.6705482, "EndTime": 1616443804.6705585, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477618696424696, "count": 1, "min": 0.4477618696424696, "max": 0.4477618696424696}}} #metrics {"StartTime": 1616443804.6705964, "EndTime": 1616443804.670605, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768249504937063, "count": 1, "min": 0.44768249504937063, "max": 0.44768249504937063}}} #metrics {"StartTime": 1616443804.6706405, "EndTime": 1616443804.6706505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44859664849175346, "count": 1, "min": 0.44859664849175346, "max": 0.44859664849175346}}} #metrics {"StartTime": 1616443804.6706874, "EndTime": 1616443804.6706984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768248745388456, "count": 1, "min": 0.44768248745388456, "max": 0.44768248745388456}}} #metrics {"StartTime": 1616443804.6707468, "EndTime": 1616443804.6707566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485966472032335, "count": 1, "min": 0.4485966472032335, "max": 0.4485966472032335}}} #metrics {"StartTime": 1616443804.6707973, "EndTime": 1616443804.6708083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847274925401475, "count": 1, "min": 0.6847274925401475, "max": 0.6847274925401475}}} #metrics {"StartTime": 1616443804.6708467, "EndTime": 1616443804.6708572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684827835422092, "count": 1, "min": 0.684827835422092, "max": 0.684827835422092}}} #metrics {"StartTime": 1616443804.6708975, "EndTime": 1616443804.670909, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321903483073, "count": 1, "min": 0.6847321903483073, "max": 0.6847321903483073}}} #metrics {"StartTime": 1616443804.6709478, "EndTime": 1616443804.670959, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848278663465712, "count": 1, "min": 0.6848278663465712, "max": 0.6848278663465712}}} #metrics {"StartTime": 1616443804.6709998, "EndTime": 1616443804.6710095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847360724555122, "count": 1, "min": 0.6847360724555122, "max": 0.6847360724555122}}} #metrics {"StartTime": 1616443804.671047, "EndTime": 1616443804.671058, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686161344672309, "count": 1, "min": 0.686161344672309, "max": 0.686161344672309}}} #metrics {"StartTime": 1616443804.6710954, "EndTime": 1616443804.6711047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847359544542101, "count": 1, "min": 0.6847359544542101, "max": 0.6847359544542101}}} #metrics {"StartTime": 1616443804.6711452, "EndTime": 1616443804.6711557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861613529459636, "count": 1, "min": 0.6861613529459636, "max": 0.6861613529459636}}} [03/22/2021 20:10:04 INFO 140462947600192] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.15423655078464085 [2021-03-22 20:10:06.166] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 41, "duration": 1479, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443806.9534829, "EndTime": 1616443806.95355, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15530284139224776, "count": 1, "min": 0.15530284139224776, "max": 0.15530284139224776}}} #metrics {"StartTime": 1616443806.9536252, "EndTime": 1616443806.9536393, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113691775579285, "count": 1, "min": 0.14113691775579285, "max": 0.14113691775579285}}} #metrics {"StartTime": 1616443806.953681, "EndTime": 1616443806.9536912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15527889108920068, "count": 1, "min": 0.15527889108920068, "max": 0.15527889108920068}}} #metrics {"StartTime": 1616443806.953724, "EndTime": 1616443806.9537315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14124816717229371, "count": 1, "min": 0.14124816717229371, "max": 0.14124816717229371}}} #metrics {"StartTime": 1616443806.9537647, "EndTime": 1616443806.9537725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010644391303329, "count": 1, "min": 0.14010644391303329, "max": 0.14010644391303329}}} #metrics {"StartTime": 1616443806.9538057, "EndTime": 1616443806.9538143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101316212804177, "count": 1, "min": 0.14101316212804177, "max": 0.14101316212804177}}} #metrics {"StartTime": 1616443806.9538534, "EndTime": 1616443806.953863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010536338666746, "count": 1, "min": 0.14010536338666746, "max": 0.14010536338666746}}} #metrics {"StartTime": 1616443806.9539015, "EndTime": 1616443806.953911, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410131500823417, "count": 1, "min": 0.1410131500823417, "max": 0.1410131500823417}}} #metrics {"StartTime": 1616443806.9539492, "EndTime": 1616443806.9539585, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17544787577625198, "count": 1, "min": 0.17544787577625198, "max": 0.17544787577625198}}} #metrics {"StartTime": 1616443806.9539971, "EndTime": 1616443806.9540062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174207993595867, "count": 1, "min": 0.174207993595867, "max": 0.174207993595867}}} #metrics {"StartTime": 1616443806.9540365, "EndTime": 1616443806.9540448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17471522577734774, "count": 1, "min": 0.17471522577734774, "max": 0.17471522577734774}}} #metrics {"StartTime": 1616443806.9540744, "EndTime": 1616443806.9540823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421186128067848, "count": 1, "min": 0.17421186128067848, "max": 0.17421186128067848}}} #metrics {"StartTime": 1616443806.9541156, "EndTime": 1616443806.9541228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421602821316262, "count": 1, "min": 0.17421602821316262, "max": 0.17421602821316262}}} #metrics {"StartTime": 1616443806.954143, "EndTime": 1616443806.954148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.176204293362528, "count": 1, "min": 0.176204293362528, "max": 0.176204293362528}}} #metrics {"StartTime": 1616443806.954166, "EndTime": 1616443806.9541712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421600006141413, "count": 1, "min": 0.17421600006141413, "max": 0.17421600006141413}}} #metrics {"StartTime": 1616443806.9541895, "EndTime": 1616443806.9541945, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17620520450469554, "count": 1, "min": 0.17620520450469554, "max": 0.17620520450469554}}} #metrics {"StartTime": 1616443806.9542124, "EndTime": 1616443806.9542172, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44876419400331374, "count": 1, "min": 0.44876419400331374, "max": 0.44876419400331374}}} #metrics {"StartTime": 1616443806.9542367, "EndTime": 1616443806.9542434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4502522797285929, "count": 1, "min": 0.4502522797285929, "max": 0.4502522797285929}}} #metrics {"StartTime": 1616443806.9542775, "EndTime": 1616443806.954286, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490717924590734, "count": 1, "min": 0.4490717924590734, "max": 0.4490717924590734}}} #metrics {"StartTime": 1616443806.9543245, "EndTime": 1616443806.9543338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4502552459484004, "count": 1, "min": 0.4502552459484004, "max": 0.4502552459484004}}} #metrics {"StartTime": 1616443806.9543717, "EndTime": 1616443806.954381, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934689486430685, "count": 1, "min": 0.44934689486430685, "max": 0.44934689486430685}}} #metrics {"StartTime": 1616443806.9544187, "EndTime": 1616443806.9544277, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45035993526310536, "count": 1, "min": 0.45035993526310536, "max": 0.45035993526310536}}} #metrics {"StartTime": 1616443806.9544659, "EndTime": 1616443806.9544754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934707433170346, "count": 1, "min": 0.44934707433170346, "max": 0.44934707433170346}}} #metrics {"StartTime": 1616443806.954513, "EndTime": 1616443806.9545221, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45035991306653445, "count": 1, "min": 0.45035991306653445, "max": 0.45035991306653445}}} #metrics {"StartTime": 1616443806.9545586, "EndTime": 1616443806.954568, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847793175773628, "count": 1, "min": 0.6847793175773628, "max": 0.6847793175773628}}} #metrics {"StartTime": 1616443806.9546037, "EndTime": 1616443806.9546115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856955950027961, "count": 1, "min": 0.6856955950027961, "max": 0.6856955950027961}}} #metrics {"StartTime": 1616443806.9546432, "EndTime": 1616443806.954652, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848261290626871, "count": 1, "min": 0.6848261290626871, "max": 0.6848261290626871}}} #metrics {"StartTime": 1616443806.9546788, "EndTime": 1616443806.9546843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857896784169466, "count": 1, "min": 0.6857896784169466, "max": 0.6857896784169466}}} #metrics {"StartTime": 1616443806.9547024, "EndTime": 1616443806.9547074, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848079062193363, "count": 1, "min": 0.6848079062193363, "max": 0.6848079062193363}}} #metrics {"StartTime": 1616443806.9547257, "EndTime": 1616443806.9547303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.685420044335106, "count": 1, "min": 0.685420044335106, "max": 0.685420044335106}}} #metrics {"StartTime": 1616443806.9547482, "EndTime": 1616443806.954753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174182620479, "count": 1, "min": 0.6848174182620479, "max": 0.6848174182620479}}} #metrics {"StartTime": 1616443806.954771, "EndTime": 1616443806.9547756, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854200600351196, "count": 1, "min": 0.6854200600351196, "max": 0.6854200600351196}}} [03/22/2021 20:10:06 INFO 140462947600192] #quality_metric: host=algo-1, epoch=13, validation binary_classification_cross_entropy_objective <loss>=0.15530284139224776 [03/22/2021 20:10:06 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:10:06 INFO 140462947600192] Epoch 13: Loss improved. Updating best model [03/22/2021 20:10:06 INFO 140462947600192] Saving model for epoch: 13 [03/22/2021 20:10:06 INFO 140462947600192] Saved checkpoint to "/tmp/tmpidyqr6nl/mx-mod-0000.params" [03/22/2021 20:10:06 INFO 140462947600192] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs #metrics {"StartTime": 1616443793.4381628, "EndTime": 1616443806.9606142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6325454.0, "count": 1, "min": 6325454, "max": 6325454}, "Total Batches Seen": {"sum": 6326.0, "count": 1, "min": 6326, "max": 6326}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:10:06 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=33348.695791376995 records/second [2021-03-22 20:10:17.368] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 31, "duration": 10404, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616443817.3685722, "EndTime": 1616443817.3686442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1541779549153646, "count": 1, "min": 0.1541779549153646, "max": 0.1541779549153646}}} #metrics {"StartTime": 1616443817.368777, "EndTime": 1616443817.3687994, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13945421108669706, "count": 1, "min": 0.13945421108669706, "max": 0.13945421108669706}}} #metrics {"StartTime": 1616443817.368849, "EndTime": 1616443817.36886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1539471479627821, "count": 1, "min": 0.1539471479627821, "max": 0.1539471479627821}}} #metrics {"StartTime": 1616443817.3689003, "EndTime": 1616443817.3689113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13956278332180447, "count": 1, "min": 0.13956278332180447, "max": 0.13956278332180447}}} #metrics {"StartTime": 1616443817.3689544, "EndTime": 1616443817.368965, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839451741536457, "count": 1, "min": 0.13839451741536457, "max": 0.13839451741536457}}} #metrics {"StartTime": 1616443817.3690045, "EndTime": 1616443817.3690155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14070810606214734, "count": 1, "min": 0.14070810606214734, "max": 0.14070810606214734}}} #metrics {"StartTime": 1616443817.3690546, "EndTime": 1616443817.3690658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1383934470960829, "count": 1, "min": 0.1383934470960829, "max": 0.1383934470960829}}} #metrics {"StartTime": 1616443817.3691077, "EndTime": 1616443817.3691192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1407081004163954, "count": 1, "min": 0.1407081004163954, "max": 0.1407081004163954}}} #metrics {"StartTime": 1616443817.3691537, "EndTime": 1616443817.369163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1744675031873915, "count": 1, "min": 0.1744675031873915, "max": 0.1744675031873915}}} #metrics {"StartTime": 1616443817.3692012, "EndTime": 1616443817.3692117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17334780022515192, "count": 1, "min": 0.17334780022515192, "max": 0.17334780022515192}}} #metrics {"StartTime": 1616443817.3692498, "EndTime": 1616443817.3692603, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17367593760172526, "count": 1, "min": 0.17367593760172526, "max": 0.17367593760172526}}} #metrics {"StartTime": 1616443817.3693, "EndTime": 1616443817.3693113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17334801317003037, "count": 1, "min": 0.17334801317003037, "max": 0.17334801317003037}}} #metrics {"StartTime": 1616443817.3693514, "EndTime": 1616443817.3693616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732128406100803, "count": 1, "min": 0.1732128406100803, "max": 0.1732128406100803}}} #metrics {"StartTime": 1616443817.3693972, "EndTime": 1616443817.369407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1749624521891276, "count": 1, "min": 0.1749624521891276, "max": 0.1749624521891276}}} #metrics {"StartTime": 1616443817.369444, "EndTime": 1616443817.369454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321285230848524, "count": 1, "min": 0.17321285230848524, "max": 0.17321285230848524}}} #metrics {"StartTime": 1616443817.3694959, "EndTime": 1616443817.3695064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496263997395833, "count": 1, "min": 0.17496263997395833, "max": 0.17496263997395833}}} #metrics {"StartTime": 1616443817.3695457, "EndTime": 1616443817.369558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476731851535373, "count": 1, "min": 0.4476731851535373, "max": 0.4476731851535373}}} #metrics {"StartTime": 1616443817.3695984, "EndTime": 1616443817.3696098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477570297580295, "count": 1, "min": 0.4477570297580295, "max": 0.4477570297580295}}} #metrics {"StartTime": 1616443817.3696487, "EndTime": 1616443817.3696594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767955349392363, "count": 1, "min": 0.44767955349392363, "max": 0.44767955349392363}}} #metrics {"StartTime": 1616443817.369698, "EndTime": 1616443817.3697088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775702996148004, "count": 1, "min": 0.44775702996148004, "max": 0.44775702996148004}}} #metrics {"StartTime": 1616443817.3697467, "EndTime": 1616443817.369756, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768161980523, "count": 1, "min": 0.44768161980523, "max": 0.44768161980523}}} #metrics {"StartTime": 1616443817.3697903, "EndTime": 1616443817.3698008, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485684922281901, "count": 1, "min": 0.4485684922281901, "max": 0.4485684922281901}}} #metrics {"StartTime": 1616443817.3698368, "EndTime": 1616443817.3698466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768161892361114, "count": 1, "min": 0.44768161892361114, "max": 0.44768161892361114}}} #metrics {"StartTime": 1616443817.3698828, "EndTime": 1616443817.369892, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44856849148220485, "count": 1, "min": 0.44856849148220485, "max": 0.44856849148220485}}} #metrics {"StartTime": 1616443817.369927, "EndTime": 1616443817.3699374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847277450900607, "count": 1, "min": 0.6847277450900607, "max": 0.6847277450900607}}} #metrics {"StartTime": 1616443817.369975, "EndTime": 1616443817.369985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848239320203993, "count": 1, "min": 0.6848239320203993, "max": 0.6848239320203993}}} #metrics {"StartTime": 1616443817.3700235, "EndTime": 1616443817.3700337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321809895833, "count": 1, "min": 0.6847321809895833, "max": 0.6847321809895833}}} #metrics {"StartTime": 1616443817.3700724, "EndTime": 1616443817.3700824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848236683485243, "count": 1, "min": 0.6848236683485243, "max": 0.6848236683485243}}} #metrics {"StartTime": 1616443817.370121, "EndTime": 1616443817.3701317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847329012044271, "count": 1, "min": 0.6847329012044271, "max": 0.6847329012044271}}} #metrics {"StartTime": 1616443817.3701723, "EndTime": 1616443817.3701825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036943901909, "count": 1, "min": 0.6861036943901909, "max": 0.6861036943901909}}} #metrics {"StartTime": 1616443817.3702188, "EndTime": 1616443817.3702292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847330338541666, "count": 1, "min": 0.6847330338541666, "max": 0.6847330338541666}}} #metrics {"StartTime": 1616443817.370267, "EndTime": 1616443817.3702767, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036965603299, "count": 1, "min": 0.6861036965603299, "max": 0.6861036965603299}}} [03/22/2021 20:10:17 INFO 140462947600192] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.1541779549153646 [2021-03-22 20:10:18.450] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 44, "duration": 1063, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616443819.1266139, "EndTime": 1616443819.1266773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15524712860827458, "count": 1, "min": 0.15524712860827458, "max": 0.15524712860827458}}} #metrics {"StartTime": 1616443819.126748, "EndTime": 1616443819.126761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1409578622138223, "count": 1, "min": 0.1409578622138223, "max": 0.1409578622138223}}} #metrics {"StartTime": 1616443819.126793, "EndTime": 1616443819.1268017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1547708400031322, "count": 1, "min": 0.1547708400031322, "max": 0.1547708400031322}}} #metrics {"StartTime": 1616443819.126837, "EndTime": 1616443819.126845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14105002630131241, "count": 1, "min": 0.14105002630131241, "max": 0.14105002630131241}}} #metrics {"StartTime": 1616443819.1268733, "EndTime": 1616443819.1268804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401014421052579, "count": 1, "min": 0.1401014421052579, "max": 0.1401014421052579}}} #metrics {"StartTime": 1616443819.1269116, "EndTime": 1616443819.1269205, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410452555950301, "count": 1, "min": 0.1410452555950301, "max": 0.1410452555950301}}} #metrics {"StartTime": 1616443819.126958, "EndTime": 1616443819.126966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010053231653982, "count": 1, "min": 0.14010053231653982, "max": 0.14010053231653982}}} #metrics {"StartTime": 1616443819.1269999, "EndTime": 1616443819.1270082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14104530628171186, "count": 1, "min": 0.14104530628171186, "max": 0.14104530628171186}}} #metrics {"StartTime": 1616443819.1270428, "EndTime": 1616443819.127052, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17541886025632297, "count": 1, "min": 0.17541886025632297, "max": 0.17541886025632297}}} #metrics {"StartTime": 1616443819.1270857, "EndTime": 1616443819.1270952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421151161701393, "count": 1, "min": 0.17421151161701393, "max": 0.17421151161701393}}} #metrics {"StartTime": 1616443819.1271236, "EndTime": 1616443819.1271298, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17460872933694144, "count": 1, "min": 0.17460872933694144, "max": 0.17460872933694144}}} #metrics {"StartTime": 1616443819.1271608, "EndTime": 1616443819.127167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421424930688229, "count": 1, "min": 0.17421424930688229, "max": 0.17421424930688229}}} #metrics {"StartTime": 1616443819.1271956, "EndTime": 1616443819.1272016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420219135808884, "count": 1, "min": 0.17420219135808884, "max": 0.17420219135808884}}} #metrics {"StartTime": 1616443819.1272318, "EndTime": 1616443819.1272414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.175763032435102, "count": 1, "min": 0.175763032435102, "max": 0.175763032435102}}} #metrics {"StartTime": 1616443819.1272771, "EndTime": 1616443819.1272864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420216638694655, "count": 1, "min": 0.17420216638694655, "max": 0.17420216638694655}}} #metrics {"StartTime": 1616443819.1273255, "EndTime": 1616443819.127335, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17576320581197613, "count": 1, "min": 0.17576320581197613, "max": 0.17576320581197613}}} #metrics {"StartTime": 1616443819.127375, "EndTime": 1616443819.1273847, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44876449988288875, "count": 1, "min": 0.44876449988288875, "max": 0.44876449988288875}}} #metrics {"StartTime": 1616443819.127421, "EndTime": 1616443819.1274295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45038039860667034, "count": 1, "min": 0.45038039860667034, "max": 0.45038039860667034}}} #metrics {"StartTime": 1616443819.1274624, "EndTime": 1616443819.1274717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44907411768522293, "count": 1, "min": 0.44907411768522293, "max": 0.44907411768522293}}} #metrics {"StartTime": 1616443819.1275084, "EndTime": 1616443819.1275175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45038215754957134, "count": 1, "min": 0.45038215754957134, "max": 0.45038215754957134}}} #metrics {"StartTime": 1616443819.1275527, "EndTime": 1616443819.1275613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912068636171654, "count": 1, "min": 0.44912068636171654, "max": 0.44912068636171654}}} #metrics {"StartTime": 1616443819.1275964, "EndTime": 1616443819.127604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497088527222654, "count": 1, "min": 0.4497088527222654, "max": 0.4497088527222654}}} #metrics {"StartTime": 1616443819.1276357, "EndTime": 1616443819.1276438, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912077054627214, "count": 1, "min": 0.44912077054627214, "max": 0.44912077054627214}}} #metrics {"StartTime": 1616443819.1276796, "EndTime": 1616443819.1276884, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497088443308788, "count": 1, "min": 0.4497088443308788, "max": 0.4497088443308788}}} #metrics {"StartTime": 1616443819.1277225, "EndTime": 1616443819.1277318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847818146915919, "count": 1, "min": 0.6847818146915919, "max": 0.6847818146915919}}} #metrics {"StartTime": 1616443819.1277647, "EndTime": 1616443819.127774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856624888172593, "count": 1, "min": 0.6856624888172593, "max": 0.6856624888172593}}} #metrics {"StartTime": 1616443819.1278083, "EndTime": 1616443819.1278172, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848271490221901, "count": 1, "min": 0.6848271490221901, "max": 0.6848271490221901}}} #metrics {"StartTime": 1616443819.1278539, "EndTime": 1616443819.1278625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857717530617842, "count": 1, "min": 0.6857717530617842, "max": 0.6857717530617842}}} #metrics {"StartTime": 1616443819.1278994, "EndTime": 1616443819.1279087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174626551897, "count": 1, "min": 0.6848174626551897, "max": 0.6848174626551897}}} #metrics {"StartTime": 1616443819.1279407, "EndTime": 1616443819.127949, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247501618942, "count": 1, "min": 0.6855247501618942, "max": 0.6855247501618942}}} #metrics {"StartTime": 1616443819.1279814, "EndTime": 1616443819.1279898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848125983578782, "count": 1, "min": 0.6848125983578782, "max": 0.6848125983578782}}} #metrics {"StartTime": 1616443819.1280255, "EndTime": 1616443819.128034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247525981032, "count": 1, "min": 0.6855247525981032, "max": 0.6855247525981032}}} [03/22/2021 20:10:19 INFO 140462947600192] #quality_metric: host=algo-1, epoch=14, validation binary_classification_cross_entropy_objective <loss>=0.15524712860827458 [03/22/2021 20:10:19 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:10:19 INFO 140462947600192] Epoch 14: Loss improved. Updating best model [03/22/2021 20:10:19 INFO 140462947600192] Saving model for epoch: 14 [03/22/2021 20:10:19 INFO 140462947600192] Saved checkpoint to "/tmp/tmppuqbbztj/mx-mod-0000.params" [03/22/2021 20:10:19 INFO 140462947600192] #progress_metric: host=algo-1, completed 100.0 % of epochs #metrics {"StartTime": 1616443806.9635627, "EndTime": 1616443819.1331801, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6776415.0, "count": 1, "min": 6776415, "max": 6776415}, "Total Batches Seen": {"sum": 6777.0, "count": 1, "min": 6777, "max": 6777}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:10:19 INFO 140462947600192] #throughput_metric: host=algo-1, train throughput=37055.91501791625 records/second [03/22/2021 20:10:19 WARNING 140462947600192] wait_for_all_workers will not sync workers since the kv store is not running distributed [03/22/2021 20:10:19 WARNING 140462947600192] wait_for_all_workers will not sync workers since the kv store is not running distributed [2021-03-22 20:10:20.229] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 47, "duration": 1081, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:10:20 INFO 140462947600192] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:10:20 INFO 140462947600192] Epoch 14: Loss improved. Updating best model [2021-03-22 20:10:21.110] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 49, "duration": 137, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.1401014421052579) [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('binary_classification_accuracy', 0.9505765478091184) [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('binary_f_1.000', 0.9500591546266088) [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('precision', 0.9693112403526098) [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('recall', 0.9315569304320315) [03/22/2021 20:10:21 INFO 140462947600192] #validation_score (algo-1) : ('roc_auc_score', 0.9841679680211635) [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation binary_classification_cross_entropy_objective <loss>=0.1401014421052579 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation binary_classification_accuracy <score>=0.9505765478091184 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation binary_f_1.000 <score>=0.9500591546266088 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation precision <score>=0.9693112403526098 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation recall <score>=0.9315569304320315 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, validation roc_auc_score <score>=0.9841679680211635 [03/22/2021 20:10:21 INFO 140462947600192] Best model found for hyperparameters: {"optimizer": "adam", "learning_rate": 0.1, "wd": 0.0001, "l1": 0.0, "lr_scheduler_step": 10, "lr_scheduler_factor": 0.99, "lr_scheduler_minimum_lr": 1e-05} [03/22/2021 20:10:21 INFO 140462947600192] Saved checkpoint to "/tmp/tmpggcl0wp_/mx-mod-0000.params" [2021-03-22 20:10:21.135] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 0, "duration": 195976, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:10:21.266] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 1, "duration": 130, "num_examples": 57, "num_bytes": 8117424} #metrics {"StartTime": 1616443821.135019, "EndTime": 1616443821.2869642, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "test_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Total Batches Seen": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Max Records Seen Between Resets": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Max Batches Seen Between Resets": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Reset Count": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Number of Records Since Last Reset": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Number of Batches Since Last Reset": {"sum": 57.0, "count": 1, "min": 57, "max": 57}}} [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.14020745627485193) [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('binary_classification_accuracy', 0.9501694133508364) [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('binary_f_1.000', 0.9494465940790066) [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('precision', 0.9702074444607915) [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('recall', 0.9295556260351693) [03/22/2021 20:10:21 INFO 140462947600192] #test_score (algo-1) : ('roc_auc_score', 0.9838786846397285) [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test binary_classification_cross_entropy_objective <loss>=0.14020745627485193 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test binary_classification_accuracy <score>=0.9501694133508364 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test binary_f_1.000 <score>=0.9494465940790066 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test precision <score>=0.9702074444607915 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test recall <score>=0.9295556260351693 [03/22/2021 20:10:21 INFO 140462947600192] #quality_metric: host=algo-1, test roc_auc_score <score>=0.9838786846397285 #metrics {"StartTime": 1616443625.1491637, "EndTime": 1616443821.2909431, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training"}, "Metrics": {"initialize.time": {"sum": 227.52833366394043, "count": 1, "min": 227.52833366394043, "max": 227.52833366394043}, "epochs": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "check_early_stopping.time": {"sum": 12.844562530517578, "count": 16, "min": 0.6847381591796875, "max": 1.1179447174072266}, "update.time": {"sum": 193655.84802627563, "count": 15, "min": 12167.507410049438, "max": 13566.564321517944}, "finalize.time": {"sum": 1999.2952346801758, "count": 1, "min": 1999.2952346801758, "max": 1999.2952346801758}, "setuptime": {"sum": 23.801565170288086, "count": 1, "min": 23.801565170288086, "max": 23.801565170288086}, "totaltime": {"sum": 196398.0667591095, "count": 1, "min": 196398.0667591095, "max": 196398.0667591095}}} 2021-03-22 20:10:34 Uploading - Uploading generated training model 2021-03-22 20:10:34 Completed - Training job completed Training seconds: 250 Billable seconds: 250
Increasing the number of examples made the recall to go up 0.929.
from sklearn.preprocessing import StandardScaler
scaler = StandardScaler()
scaler.fit(train_features)
train_features_scaled = scaler.transform(train_features)
val_features_scaled = scaler.transform(val_features)
test_features_scaled = scaler.transform(test_features)
train_features_scaled.shape
(450961, 25)
linear_estimator_smote = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
train_instance_count=1,
train_instance_type='ml.m5.xlarge',
predictor_type='binary_classifier')
train_records_smote = linear_estimator_smote.record_set(train_features_scaled, train_labels, channel='train')
val_records_smote = linear_estimator_smote.record_set(val_features_scaled, val_labels, channel='validation')
test_records_smote = linear_estimator_smote.record_set(test_features_scaled, test_labels, channel='test')
linear_estimator_smote.fit([train_records_smote, val_records_smote, test_records_smote])
train_instance_count has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. train_instance_type has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
2021-03-22 20:17:04 Starting - Starting the training job... 2021-03-22 20:17:15 Starting - Launching requested ML instancesProfilerReport-1616444224: InProgress ...... 2021-03-22 20:18:26 Starting - Preparing the instances for training...... 2021-03-22 20:19:23 Downloading - Downloading input data... 2021-03-22 20:19:59 Training - Training image download completed. Training in progress..Docker entrypoint called with argument(s): train Running default environment configuration script [03/22/2021 20:20:04 INFO 140710537553728] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'} [03/22/2021 20:20:04 INFO 140710537553728] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'feature_dim': '25', 'predictor_type': 'binary_classifier', 'mini_batch_size': '1000'} [03/22/2021 20:20:05 INFO 140710537553728] Final configuration: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': '25', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'} [03/22/2021 20:20:05 WARNING 140710537553728] Loggers have already been setup. Process 1 is a worker. [03/22/2021 20:20:05 INFO 140710537553728] Using default worker. [03/22/2021 20:20:05 INFO 140710537553728] Checkpoint loading and saving are disabled. [2021-03-22 20:20:05.377] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:20:05.381] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:20:05.411] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 0, "duration": 37, "num_examples": 1, "num_bytes": 144000} [03/22/2021 20:20:05 INFO 140710537553728] Create Store: local [2021-03-22 20:20:05.517] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 1, "duration": 105, "num_examples": 11, "num_bytes": 1584000} [03/22/2021 20:20:05 INFO 140710537553728] Scaler algorithm parameters <algorithm.scaler.ScalerAlgorithmStable object at 0x7ff958e5fb90> [03/22/2021 20:20:05 INFO 140710537553728] Scaling model computed with parameters: {'stdev_label': None, 'stdev_weight': [0.9713653 0.97596407 0.98318905 0.9974681 0.97018737 0.99177593 0.9629723 0.9880739 0.99763215 1.0193474 0.99344146 1.001784 1.0123072 0.99932253 0.9486914 0.97398496 0.9881266 0.9385111 1.0090529 0.98432904 1.0032493 0.9964678 0.97149736 0.9575173 1.0133007 ] <NDArray 25 @cpu(0)>, 'mean_label': None, 'mean_weight': [ 1.2557831e-02 -1.0025993e-02 4.1458039e-03 -8.3622988e-05 9.3291048e-03 -6.6056717e-03 -9.4541226e-04 -1.7732058e-03 -4.1019134e-03 6.0480991e-03 2.6982122e-03 -2.6886470e-03 -8.2443254e-03 6.7328308e-03 3.1883938e-03 7.5805872e-03 3.4852573e-03 6.1227418e-03 1.3463807e-03 -1.4197718e-02 1.6858377e-02 6.2272842e-03 6.8699857e-03 -2.5005448e-03 1.5107834e-02] <NDArray 25 @cpu(0)>} [03/22/2021 20:20:05 INFO 140710537553728] nvidia-smi took: 0.025226354598999023 secs to identify 0 gpus [03/22/2021 20:20:05 INFO 140710537553728] Number of GPUs being used: 0 #metrics {"StartTime": 1616444405.6278002, "EndTime": 1616444405.6278536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "init_train_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12000.0, "count": 1, "min": 12000, "max": 12000}, "Total Batches Seen": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Max Records Seen Between Resets": {"sum": 11000.0, "count": 1, "min": 11000, "max": 11000}, "Max Batches Seen Between Resets": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Reset Count": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Number of Records Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}, "Number of Batches Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}}} [2021-03-22 20:20:16.328] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 3, "duration": 10699, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444416.3280685, "EndTime": 1616444416.3281634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2697672920735677, "count": 1, "min": 0.2697672920735677, "max": 0.2697672920735677}}} #metrics {"StartTime": 1616444416.328261, "EndTime": 1616444416.328299, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2619445831637912, "count": 1, "min": 0.2619445831637912, "max": 0.2619445831637912}}} #metrics {"StartTime": 1616444416.3283453, "EndTime": 1616444416.328358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.28083473893907335, "count": 1, "min": 0.28083473893907335, "max": 0.28083473893907335}}} #metrics {"StartTime": 1616444416.3284016, "EndTime": 1616444416.3284128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26674126068115234, "count": 1, "min": 0.26674126068115234, "max": 0.26674126068115234}}} #metrics {"StartTime": 1616444416.3284545, "EndTime": 1616444416.3284655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1549632176208496, "count": 1, "min": 0.1549632176208496, "max": 0.1549632176208496}}} #metrics {"StartTime": 1616444416.3285012, "EndTime": 1616444416.3285117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15457015224880644, "count": 1, "min": 0.15457015224880644, "max": 0.15457015224880644}}} #metrics {"StartTime": 1616444416.3285496, "EndTime": 1616444416.3285592, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15427642801920574, "count": 1, "min": 0.15427642801920574, "max": 0.15427642801920574}}} #metrics {"StartTime": 1616444416.3285983, "EndTime": 1616444416.3286092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15465753612942165, "count": 1, "min": 0.15465753612942165, "max": 0.15465753612942165}}} #metrics {"StartTime": 1616444416.328647, "EndTime": 1616444416.3286572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2755368982272678, "count": 1, "min": 0.2755368982272678, "max": 0.2755368982272678}}} #metrics {"StartTime": 1616444416.3286972, "EndTime": 1616444416.328708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2724716899278429, "count": 1, "min": 0.2724716899278429, "max": 0.2724716899278429}}} #metrics {"StartTime": 1616444416.3287475, "EndTime": 1616444416.3287578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2665694301689996, "count": 1, "min": 0.2665694301689996, "max": 0.2665694301689996}}} #metrics {"StartTime": 1616444416.3287983, "EndTime": 1616444416.3288093, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26785976355658636, "count": 1, "min": 0.26785976355658636, "max": 0.26785976355658636}}} #metrics {"StartTime": 1616444416.3288486, "EndTime": 1616444416.3288589, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17992738447401257, "count": 1, "min": 0.17992738447401257, "max": 0.17992738447401257}}} #metrics {"StartTime": 1616444416.3288972, "EndTime": 1616444416.3289077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18042501746283637, "count": 1, "min": 0.18042501746283637, "max": 0.18042501746283637}}} #metrics {"StartTime": 1616444416.3289442, "EndTime": 1616444416.3289545, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18035446360270183, "count": 1, "min": 0.18035446360270183, "max": 0.18035446360270183}}} #metrics {"StartTime": 1616444416.3289962, "EndTime": 1616444416.3290064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17958980523003473, "count": 1, "min": 0.17958980523003473, "max": 0.17958980523003473}}} #metrics {"StartTime": 1616444416.3290448, "EndTime": 1616444416.3290553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4553869474283854, "count": 1, "min": 0.4553869474283854, "max": 0.4553869474283854}}} #metrics {"StartTime": 1616444416.3290958, "EndTime": 1616444416.3291059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45205989685058595, "count": 1, "min": 0.45205989685058595, "max": 0.45205989685058595}}} #metrics {"StartTime": 1616444416.3291476, "EndTime": 1616444416.32916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4540563852267795, "count": 1, "min": 0.4540563852267795, "max": 0.4540563852267795}}} #metrics {"StartTime": 1616444416.329199, "EndTime": 1616444416.32921, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45335088840060767, "count": 1, "min": 0.45335088840060767, "max": 0.45335088840060767}}} #metrics {"StartTime": 1616444416.32925, "EndTime": 1616444416.3292606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44968419067382814, "count": 1, "min": 0.44968419067382814, "max": 0.44968419067382814}}} #metrics {"StartTime": 1616444416.3292902, "EndTime": 1616444416.3293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4500412001546224, "count": 1, "min": 0.4500412001546224, "max": 0.4500412001546224}}} #metrics {"StartTime": 1616444416.329338, "EndTime": 1616444416.3293486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4496383820258247, "count": 1, "min": 0.4496383820258247, "max": 0.4496383820258247}}} #metrics {"StartTime": 1616444416.3293855, "EndTime": 1616444416.3293953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.450079884507921, "count": 1, "min": 0.450079884507921, "max": 0.450079884507921}}} #metrics {"StartTime": 1616444416.3294325, "EndTime": 1616444416.3294427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6843651310221354, "count": 1, "min": 0.6843651310221354, "max": 0.6843651310221354}}} #metrics {"StartTime": 1616444416.329482, "EndTime": 1616444416.329493, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854449141438802, "count": 1, "min": 0.6854449141438802, "max": 0.6854449141438802}}} #metrics {"StartTime": 1616444416.3295307, "EndTime": 1616444416.3295426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847846477593316, "count": 1, "min": 0.6847846477593316, "max": 0.6847846477593316}}} #metrics {"StartTime": 1616444416.3295825, "EndTime": 1616444416.3295925, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848822820366753, "count": 1, "min": 0.6848822820366753, "max": 0.6848822820366753}}} #metrics {"StartTime": 1616444416.329631, "EndTime": 1616444416.329641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6870081060112847, "count": 1, "min": 0.6870081060112847, "max": 0.6870081060112847}}} #metrics {"StartTime": 1616444416.3296785, "EndTime": 1616444416.3296888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872150086805555, "count": 1, "min": 0.6872150086805555, "max": 0.6872150086805555}}} #metrics {"StartTime": 1616444416.3297262, "EndTime": 1616444416.3297367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6871324627007378, "count": 1, "min": 0.6871324627007378, "max": 0.6871324627007378}}} #metrics {"StartTime": 1616444416.3297772, "EndTime": 1616444416.3297882, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872138528103299, "count": 1, "min": 0.6872138528103299, "max": 0.6872138528103299}}} [03/22/2021 20:20:16 INFO 140710537553728] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.2697672920735677 [2021-03-22 20:20:16.346] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 0, "duration": 10968, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:20:17.660] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 2, "duration": 1313, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444418.4616685, "EndTime": 1616444418.4617336, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20004103739929469, "count": 1, "min": 0.20004103739929469, "max": 0.20004103739929469}}} #metrics {"StartTime": 1616444418.461807, "EndTime": 1616444418.461817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19091413523978706, "count": 1, "min": 0.19091413523978706, "max": 0.19091413523978706}}} #metrics {"StartTime": 1616444418.4618437, "EndTime": 1616444418.4618514, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20627407813634732, "count": 1, "min": 0.20627407813634732, "max": 0.20627407813634732}}} #metrics {"StartTime": 1616444418.4618816, "EndTime": 1616444418.4618902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19310116432058658, "count": 1, "min": 0.19310116432058658, "max": 0.19310116432058658}}} #metrics {"StartTime": 1616444418.4619188, "EndTime": 1616444418.461926, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14326625273797408, "count": 1, "min": 0.14326625273797408, "max": 0.14326625273797408}}} #metrics {"StartTime": 1616444418.4619539, "EndTime": 1616444418.461962, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14325362701713776, "count": 1, "min": 0.14325362701713776, "max": 0.14325362701713776}}} #metrics {"StartTime": 1616444418.4619958, "EndTime": 1616444418.4620051, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14311495766226062, "count": 1, "min": 0.14311495766226062, "max": 0.14311495766226062}}} #metrics {"StartTime": 1616444418.462037, "EndTime": 1616444418.462046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14342271149401675, "count": 1, "min": 0.14342271149401675, "max": 0.14342271149401675}}} #metrics {"StartTime": 1616444418.462073, "EndTime": 1616444418.4620821, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20897231008094191, "count": 1, "min": 0.20897231008094191, "max": 0.20897231008094191}}} #metrics {"StartTime": 1616444418.4621148, "EndTime": 1616444418.4621239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20238041196792328, "count": 1, "min": 0.20238041196792328, "max": 0.20238041196792328}}} #metrics {"StartTime": 1616444418.4621532, "EndTime": 1616444418.4621627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20547102812610873, "count": 1, "min": 0.20547102812610873, "max": 0.20547102812610873}}} #metrics {"StartTime": 1616444418.462192, "EndTime": 1616444418.462201, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20001879724729604, "count": 1, "min": 0.20001879724729604, "max": 0.20001879724729604}}} #metrics {"StartTime": 1616444418.4622307, "EndTime": 1616444418.4622397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17538609906505012, "count": 1, "min": 0.17538609906505012, "max": 0.17538609906505012}}} #metrics {"StartTime": 1616444418.4622698, "EndTime": 1616444418.4622784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17505503423209307, "count": 1, "min": 0.17505503423209307, "max": 0.17505503423209307}}} #metrics {"StartTime": 1616444418.4623072, "EndTime": 1616444418.462317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1753186013230369, "count": 1, "min": 0.1753186013230369, "max": 0.1753186013230369}}} #metrics {"StartTime": 1616444418.4623487, "EndTime": 1616444418.462358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1750756415826792, "count": 1, "min": 0.1750756415826792, "max": 0.1750756415826792}}} #metrics {"StartTime": 1616444418.4623938, "EndTime": 1616444418.4624026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496440744662255, "count": 1, "min": 0.4496440744662255, "max": 0.4496440744662255}}} #metrics {"StartTime": 1616444418.462427, "EndTime": 1616444418.4624364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498555330767453, "count": 1, "min": 0.4498555330767453, "max": 0.4498555330767453}}} #metrics {"StartTime": 1616444418.4624624, "EndTime": 1616444418.462471, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44967790447652645, "count": 1, "min": 0.44967790447652645, "max": 0.44967790447652645}}} #metrics {"StartTime": 1616444418.4624946, "EndTime": 1616444418.4625034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44995365058231673, "count": 1, "min": 0.44995365058231673, "max": 0.44995365058231673}}} #metrics {"StartTime": 1616444418.4625335, "EndTime": 1616444418.4625423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493002254911744, "count": 1, "min": 0.4493002254911744, "max": 0.4493002254911744}}} #metrics {"StartTime": 1616444418.462575, "EndTime": 1616444418.4625835, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4483477007947282, "count": 1, "min": 0.4483477007947282, "max": 0.4483477007947282}}} #metrics {"StartTime": 1616444418.4626122, "EndTime": 1616444418.4626217, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44928894638486505, "count": 1, "min": 0.44928894638486505, "max": 0.44928894638486505}}} #metrics {"StartTime": 1616444418.4626527, "EndTime": 1616444418.4626586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45016619438860295, "count": 1, "min": 0.45016619438860295, "max": 0.45016619438860295}}} #metrics {"StartTime": 1616444418.4626887, "EndTime": 1616444418.462697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847923791765934, "count": 1, "min": 0.6847923791765934, "max": 0.6847923791765934}}} #metrics {"StartTime": 1616444418.4627256, "EndTime": 1616444418.462734, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845544609000799, "count": 1, "min": 0.6845544609000799, "max": 0.6845544609000799}}} #metrics {"StartTime": 1616444418.4627652, "EndTime": 1616444418.4627733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847500798210345, "count": 1, "min": 0.6847500798210345, "max": 0.6847500798210345}}} #metrics {"StartTime": 1616444418.4628012, "EndTime": 1616444418.46281, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845814267561667, "count": 1, "min": 0.6845814267561667, "max": 0.6845814267561667}}} #metrics {"StartTime": 1616444418.4628384, "EndTime": 1616444418.4628444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849995719851469, "count": 1, "min": 0.6849995719851469, "max": 0.6849995719851469}}} #metrics {"StartTime": 1616444418.4628685, "EndTime": 1616444418.4628766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867463046065962, "count": 1, "min": 0.6867463046065962, "max": 0.6867463046065962}}} #metrics {"StartTime": 1616444418.4629097, "EndTime": 1616444418.4629183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851805958486479, "count": 1, "min": 0.6851805958486479, "max": 0.6851805958486479}}} #metrics {"StartTime": 1616444418.4629424, "EndTime": 1616444418.4629486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867069944794855, "count": 1, "min": 0.6867069944794855, "max": 0.6867069944794855}}} [03/22/2021 20:20:18 INFO 140710537553728] #quality_metric: host=algo-1, epoch=0, validation binary_classification_cross_entropy_objective <loss>=0.20004103739929469 [03/22/2021 20:20:18 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=sampled_accuracy, value=0.9500266098988824 [03/22/2021 20:20:18 INFO 140710537553728] Epoch 0: Loss improved. Updating best model [03/22/2021 20:20:18 INFO 140710537553728] Saving model for epoch: 0 [03/22/2021 20:20:18 INFO 140710537553728] Saved checkpoint to "/tmp/tmpvx76vc1k/mx-mod-0000.params" [03/22/2021 20:20:18 INFO 140710537553728] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs #metrics {"StartTime": 1616444405.6281433, "EndTime": 1616444418.4719243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 462961.0, "count": 1, "min": 462961, "max": 462961}, "Total Batches Seen": {"sum": 463.0, "count": 1, "min": 463, "max": 463}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:20:18 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=35110.89769542701 records/second [2021-03-22 20:20:28.982] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 5, "duration": 10506, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444428.9825976, "EndTime": 1616444428.982669, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1847664303588867, "count": 1, "min": 0.1847664303588867, "max": 0.1847664303588867}}} #metrics {"StartTime": 1616444428.9827473, "EndTime": 1616444428.98276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17468985110812718, "count": 1, "min": 0.17468985110812718, "max": 0.17468985110812718}}} #metrics {"StartTime": 1616444428.9827955, "EndTime": 1616444428.982804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18961667941623264, "count": 1, "min": 0.18961667941623264, "max": 0.18961667941623264}}} #metrics {"StartTime": 1616444428.9828334, "EndTime": 1616444428.982841, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17632025516086156, "count": 1, "min": 0.17632025516086156, "max": 0.17632025516086156}}} #metrics {"StartTime": 1616444428.9828694, "EndTime": 1616444428.9828768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14118829989963108, "count": 1, "min": 0.14118829989963108, "max": 0.14118829989963108}}} #metrics {"StartTime": 1616444428.9829035, "EndTime": 1616444428.9829106, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14225948382907444, "count": 1, "min": 0.14225948382907444, "max": 0.14225948382907444}}} #metrics {"StartTime": 1616444428.9829378, "EndTime": 1616444428.9829452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14105197070651584, "count": 1, "min": 0.14105197070651584, "max": 0.14105197070651584}}} #metrics {"StartTime": 1616444428.9829738, "EndTime": 1616444428.982981, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14231038806491428, "count": 1, "min": 0.14231038806491428, "max": 0.14231038806491428}}} #metrics {"StartTime": 1616444428.9830077, "EndTime": 1616444428.9830148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19557280019124348, "count": 1, "min": 0.19557280019124348, "max": 0.19557280019124348}}} #metrics {"StartTime": 1616444428.9830413, "EndTime": 1616444428.9830484, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18844150600857204, "count": 1, "min": 0.18844150600857204, "max": 0.18844150600857204}}} #metrics {"StartTime": 1616444428.9830766, "EndTime": 1616444428.9830837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19316921549479166, "count": 1, "min": 0.19316921549479166, "max": 0.19316921549479166}}} #metrics {"StartTime": 1616444428.9831107, "EndTime": 1616444428.9831176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18693647247314454, "count": 1, "min": 0.18693647247314454, "max": 0.18693647247314454}}} #metrics {"StartTime": 1616444428.983144, "EndTime": 1616444428.983151, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17476415534125433, "count": 1, "min": 0.17476415534125433, "max": 0.17476415534125433}}} #metrics {"StartTime": 1616444428.9831774, "EndTime": 1616444428.9831843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17543563924153646, "count": 1, "min": 0.17543563924153646, "max": 0.17543563924153646}}} #metrics {"StartTime": 1616444428.9832108, "EndTime": 1616444428.9832177, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17474877756754556, "count": 1, "min": 0.17474877756754556, "max": 0.17474877756754556}}} #metrics {"StartTime": 1616444428.9832437, "EndTime": 1616444428.9832506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17550794745551215, "count": 1, "min": 0.17550794745551215, "max": 0.17550794745551215}}} #metrics {"StartTime": 1616444428.983281, "EndTime": 1616444428.9832883, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44774976704915365, "count": 1, "min": 0.44774976704915365, "max": 0.44774976704915365}}} #metrics {"StartTime": 1616444428.9833179, "EndTime": 1616444428.983325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44783198628743487, "count": 1, "min": 0.44783198628743487, "max": 0.44783198628743487}}} #metrics {"StartTime": 1616444428.9833546, "EndTime": 1616444428.9833615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44774986083984375, "count": 1, "min": 0.44774986083984375, "max": 0.44774986083984375}}} #metrics {"StartTime": 1616444428.9833882, "EndTime": 1616444428.9833953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478314262559679, "count": 1, "min": 0.4478314262559679, "max": 0.4478314262559679}}} #metrics {"StartTime": 1616444428.9834208, "EndTime": 1616444428.9834278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4483998365614149, "count": 1, "min": 0.4483998365614149, "max": 0.4483998365614149}}} #metrics {"StartTime": 1616444428.9834542, "EndTime": 1616444428.9834611, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44920295518663195, "count": 1, "min": 0.44920295518663195, "max": 0.44920295518663195}}} #metrics {"StartTime": 1616444428.9834878, "EndTime": 1616444428.9834943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44839003865559895, "count": 1, "min": 0.44839003865559895, "max": 0.44839003865559895}}} #metrics {"StartTime": 1616444428.983521, "EndTime": 1616444428.983528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44920540174696183, "count": 1, "min": 0.44920540174696183, "max": 0.44920540174696183}}} #metrics {"StartTime": 1616444428.9835541, "EndTime": 1616444428.983561, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848157303873698, "count": 1, "min": 0.6848157303873698, "max": 0.6848157303873698}}} #metrics {"StartTime": 1616444428.9835887, "EndTime": 1616444428.9835958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684882574327257, "count": 1, "min": 0.684882574327257, "max": 0.684882574327257}}} #metrics {"StartTime": 1616444428.9836218, "EndTime": 1616444428.9836287, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848149886067708, "count": 1, "min": 0.6848149886067708, "max": 0.6848149886067708}}} #metrics {"StartTime": 1616444428.9836552, "EndTime": 1616444428.9836621, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848844304741754, "count": 1, "min": 0.6848844304741754, "max": 0.6848844304741754}}} #metrics {"StartTime": 1616444428.9837446, "EndTime": 1616444428.9837534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6859979915364584, "count": 1, "min": 0.6859979915364584, "max": 0.6859979915364584}}} #metrics {"StartTime": 1616444428.9837842, "EndTime": 1616444428.983791, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864556442599826, "count": 1, "min": 0.6864556442599826, "max": 0.6864556442599826}}} #metrics {"StartTime": 1616444428.983818, "EndTime": 1616444428.983825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686006793077257, "count": 1, "min": 0.686006793077257, "max": 0.686006793077257}}} #metrics {"StartTime": 1616444428.9838529, "EndTime": 1616444428.9838598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864578961859809, "count": 1, "min": 0.6864578961859809, "max": 0.6864578961859809}}} [03/22/2021 20:20:28 INFO 140710537553728] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.1847664303588867 [2021-03-22 20:20:30.055] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 5, "duration": 1055, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444430.773628, "EndTime": 1616444430.7736938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17566183298979537, "count": 1, "min": 0.17566183298979537, "max": 0.17566183298979537}}} #metrics {"StartTime": 1616444430.7737656, "EndTime": 1616444430.7737758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.164894315006675, "count": 1, "min": 0.164894315006675, "max": 0.164894315006675}}} #metrics {"StartTime": 1616444430.7738068, "EndTime": 1616444430.7738147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17944347279406364, "count": 1, "min": 0.17944347279406364, "max": 0.17944347279406364}}} #metrics {"StartTime": 1616444430.7738435, "EndTime": 1616444430.7738512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16605123540537564, "count": 1, "min": 0.16605123540537564, "max": 0.16605123540537564}}} #metrics {"StartTime": 1616444430.7738867, "EndTime": 1616444430.7738955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14130969315698558, "count": 1, "min": 0.14130969315698558, "max": 0.14130969315698558}}} #metrics {"StartTime": 1616444430.773925, "EndTime": 1616444430.7739322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14276507426517873, "count": 1, "min": 0.14276507426517873, "max": 0.14276507426517873}}} #metrics {"StartTime": 1616444430.7739623, "EndTime": 1616444430.7739697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14127468645773564, "count": 1, "min": 0.14127468645773564, "max": 0.14127468645773564}}} #metrics {"StartTime": 1616444430.7739987, "EndTime": 1616444430.774007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14278478847447493, "count": 1, "min": 0.14278478847447493, "max": 0.14278478847447493}}} #metrics {"StartTime": 1616444430.7740352, "EndTime": 1616444430.7740436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18822914273768046, "count": 1, "min": 0.18822914273768046, "max": 0.18822914273768046}}} #metrics {"StartTime": 1616444430.774076, "EndTime": 1616444430.774085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18106209330468265, "count": 1, "min": 0.18106209330468265, "max": 0.18106209330468265}}} #metrics {"StartTime": 1616444430.7741191, "EndTime": 1616444430.7741284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18652091291074702, "count": 1, "min": 0.18652091291074702, "max": 0.18652091291074702}}} #metrics {"StartTime": 1616444430.7741575, "EndTime": 1616444430.774167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18021381196134878, "count": 1, "min": 0.18021381196134878, "max": 0.18021381196134878}}} #metrics {"StartTime": 1616444430.7742007, "EndTime": 1616444430.7742097, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421877300864058, "count": 1, "min": 0.17421877300864058, "max": 0.17421877300864058}}} #metrics {"StartTime": 1616444430.7742417, "EndTime": 1616444430.7742507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751643697357313, "count": 1, "min": 0.1751643697357313, "max": 0.1751643697357313}}} #metrics {"StartTime": 1616444430.7742848, "EndTime": 1616444430.7742937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17432523534212083, "count": 1, "min": 0.17432523534212083, "max": 0.17432523534212083}}} #metrics {"StartTime": 1616444430.774327, "EndTime": 1616444430.7743359, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17530787679263837, "count": 1, "min": 0.17530787679263837, "max": 0.17530787679263837}}} #metrics {"StartTime": 1616444430.774368, "EndTime": 1616444430.774377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496007630011704, "count": 1, "min": 0.4496007630011704, "max": 0.4496007630011704}}} #metrics {"StartTime": 1616444430.7744062, "EndTime": 1616444430.7744148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44982442999638966, "count": 1, "min": 0.44982442999638966, "max": 0.44982442999638966}}} #metrics {"StartTime": 1616444430.7744458, "EndTime": 1616444430.7744548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44964045534240493, "count": 1, "min": 0.44964045534240493, "max": 0.44964045534240493}}} #metrics {"StartTime": 1616444430.7744875, "EndTime": 1616444430.7744963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499649529679566, "count": 1, "min": 0.4499649529679566, "max": 0.4499649529679566}}} #metrics {"StartTime": 1616444430.7745328, "EndTime": 1616444430.7745426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45594722632082807, "count": 1, "min": 0.45594722632082807, "max": 0.45594722632082807}}} #metrics {"StartTime": 1616444430.7746184, "EndTime": 1616444430.7746317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44893270170771105, "count": 1, "min": 0.44893270170771105, "max": 0.44893270170771105}}} #metrics {"StartTime": 1616444430.7746713, "EndTime": 1616444430.7746813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45597891652755373, "count": 1, "min": 0.45597891652755373, "max": 0.45597891652755373}}} #metrics {"StartTime": 1616444430.7747154, "EndTime": 1616444430.7747247, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4492132701538801, "count": 1, "min": 0.4492132701538801, "max": 0.4492132701538801}}} #metrics {"StartTime": 1616444430.774758, "EndTime": 1616444430.7747667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847396707120296, "count": 1, "min": 0.6847396707120296, "max": 0.6847396707120296}}} #metrics {"StartTime": 1616444430.7748013, "EndTime": 1616444430.77481, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845663092672264, "count": 1, "min": 0.6845663092672264, "max": 0.6845663092672264}}} #metrics {"StartTime": 1616444430.7748456, "EndTime": 1616444430.7748551, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497420000527, "count": 1, "min": 0.6847497420000527, "max": 0.6847497420000527}}} #metrics {"StartTime": 1616444430.7748902, "EndTime": 1616444430.7748992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847265774420819, "count": 1, "min": 0.6847265774420819, "max": 0.6847265774420819}}} #metrics {"StartTime": 1616444430.7749326, "EndTime": 1616444430.7749412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853496952811433, "count": 1, "min": 0.6853496952811433, "max": 0.6853496952811433}}} #metrics {"StartTime": 1616444430.774988, "EndTime": 1616444430.774998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6874107335124304, "count": 1, "min": 0.6874107335124304, "max": 0.6874107335124304}}} #metrics {"StartTime": 1616444430.7750273, "EndTime": 1616444430.7750332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855064859029902, "count": 1, "min": 0.6855064859029902, "max": 0.6855064859029902}}} #metrics {"StartTime": 1616444430.7750628, "EndTime": 1616444430.7750692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6877234028018873, "count": 1, "min": 0.6877234028018873, "max": 0.6877234028018873}}} [03/22/2021 20:20:30 INFO 140710537553728] #quality_metric: host=algo-1, epoch=1, validation binary_classification_cross_entropy_objective <loss>=0.17566183298979537 [03/22/2021 20:20:30 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=sampled_accuracy, value=0.9505233280113536 [03/22/2021 20:20:30 INFO 140710537553728] Epoch 1: Loss improved. Updating best model [03/22/2021 20:20:30 INFO 140710537553728] Saving model for epoch: 1 [03/22/2021 20:20:30 INFO 140710537553728] Saved checkpoint to "/tmp/tmpxd_mtetl/mx-mod-0000.params" [03/22/2021 20:20:30 INFO 140710537553728] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs #metrics {"StartTime": 1616444418.4754755, "EndTime": 1616444430.781014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 913922.0, "count": 1, "min": 913922, "max": 913922}, "Total Batches Seen": {"sum": 914.0, "count": 1, "min": 914, "max": 914}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:20:30 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=36646.536645092725 records/second [2021-03-22 20:20:40.963] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 7, "duration": 10179, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444440.9634018, "EndTime": 1616444440.9634619, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16985383477105034, "count": 1, "min": 0.16985383477105034, "max": 0.16985383477105034}}} #metrics {"StartTime": 1616444440.963528, "EndTime": 1616444440.9635384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15863514019436306, "count": 1, "min": 0.15863514019436306, "max": 0.15863514019436306}}} #metrics {"StartTime": 1616444440.9635704, "EndTime": 1616444440.9635794, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17320562598334419, "count": 1, "min": 0.17320562598334419, "max": 0.17320562598334419}}} #metrics {"StartTime": 1616444440.9636135, "EndTime": 1616444440.9636226, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15970260511610243, "count": 1, "min": 0.15970260511610243, "max": 0.15970260511610243}}} #metrics {"StartTime": 1616444440.9636571, "EndTime": 1616444440.9636657, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13983879231770832, "count": 1, "min": 0.13983879231770832, "max": 0.13983879231770832}}} #metrics {"StartTime": 1616444440.963706, "EndTime": 1616444440.9637163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14200427437676325, "count": 1, "min": 0.14200427437676325, "max": 0.14200427437676325}}} #metrics {"StartTime": 1616444440.963755, "EndTime": 1616444440.9637651, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1397996684434679, "count": 1, "min": 0.1397996684434679, "max": 0.1397996684434679}}} #metrics {"StartTime": 1616444440.963805, "EndTime": 1616444440.9638155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14200192489624022, "count": 1, "min": 0.14200192489624022, "max": 0.14200192489624022}}} #metrics {"StartTime": 1616444440.9638538, "EndTime": 1616444440.9638643, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18366793216281466, "count": 1, "min": 0.18366793216281466, "max": 0.18366793216281466}}} #metrics {"StartTime": 1616444440.963903, "EndTime": 1616444440.9639134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17716911777072483, "count": 1, "min": 0.17716911777072483, "max": 0.17716911777072483}}} #metrics {"StartTime": 1616444440.9639523, "EndTime": 1616444440.9639614, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18230988342285157, "count": 1, "min": 0.18230988342285157, "max": 0.18230988342285157}}} #metrics {"StartTime": 1616444440.9639997, "EndTime": 1616444440.9640098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17662878831651477, "count": 1, "min": 0.17662878831651477, "max": 0.17662878831651477}}} #metrics {"StartTime": 1616444440.964049, "EndTime": 1616444440.9640598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17428289489746093, "count": 1, "min": 0.17428289489746093, "max": 0.17428289489746093}}} #metrics {"StartTime": 1616444440.9640982, "EndTime": 1616444440.9641087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17545227043999567, "count": 1, "min": 0.17545227043999567, "max": 0.17545227043999567}}} #metrics {"StartTime": 1616444440.9641485, "EndTime": 1616444440.964159, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17427346384684245, "count": 1, "min": 0.17427346384684245, "max": 0.17427346384684245}}} #metrics {"StartTime": 1616444440.964199, "EndTime": 1616444440.9642096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17549753007676866, "count": 1, "min": 0.17549753007676866, "max": 0.17549753007676866}}} #metrics {"StartTime": 1616444440.9642506, "EndTime": 1616444440.964261, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477293467203776, "count": 1, "min": 0.4477293467203776, "max": 0.4477293467203776}}} #metrics {"StartTime": 1616444440.9643228, "EndTime": 1616444440.9643352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44782462890625, "count": 1, "min": 0.44782462890625, "max": 0.44782462890625}}} #metrics {"StartTime": 1616444440.964376, "EndTime": 1616444440.9643867, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477288453504774, "count": 1, "min": 0.4477288453504774, "max": 0.4477288453504774}}} #metrics {"StartTime": 1616444440.964426, "EndTime": 1616444440.9644368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44782368828667535, "count": 1, "min": 0.44782368828667535, "max": 0.44782368828667535}}} #metrics {"StartTime": 1616444440.9644768, "EndTime": 1616444440.9644878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833698052300347, "count": 1, "min": 0.44833698052300347, "max": 0.44833698052300347}}} #metrics {"StartTime": 1616444440.964528, "EndTime": 1616444440.9645386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44916203531901044, "count": 1, "min": 0.44916203531901044, "max": 0.44916203531901044}}} #metrics {"StartTime": 1616444440.9645789, "EndTime": 1616444440.9645896, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833109402126736, "count": 1, "min": 0.44833109402126736, "max": 0.44833109402126736}}} #metrics {"StartTime": 1616444440.9646323, "EndTime": 1616444440.9646435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4491599243842231, "count": 1, "min": 0.4491599243842231, "max": 0.4491599243842231}}} #metrics {"StartTime": 1616444440.9646842, "EndTime": 1616444440.9646955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847873419867622, "count": 1, "min": 0.6847873419867622, "max": 0.6847873419867622}}} #metrics {"StartTime": 1616444440.9647367, "EndTime": 1616444440.9647477, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848741006130642, "count": 1, "min": 0.6848741006130642, "max": 0.6848741006130642}}} #metrics {"StartTime": 1616444440.9647882, "EndTime": 1616444440.9647992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684786618109809, "count": 1, "min": 0.684786618109809, "max": 0.684786618109809}}} #metrics {"StartTime": 1616444440.96484, "EndTime": 1616444440.964851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848765094672309, "count": 1, "min": 0.6848765094672309, "max": 0.6848765094672309}}} #metrics {"StartTime": 1616444440.964889, "EndTime": 1616444440.9649, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854663057454428, "count": 1, "min": 0.6854663057454428, "max": 0.6854663057454428}}} #metrics {"StartTime": 1616444440.964941, "EndTime": 1616444440.9649522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864741764322917, "count": 1, "min": 0.6864741764322917, "max": 0.6864741764322917}}} #metrics {"StartTime": 1616444440.9649916, "EndTime": 1616444440.965003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854679028320313, "count": 1, "min": 0.6854679028320313, "max": 0.6854679028320313}}} #metrics {"StartTime": 1616444440.965042, "EndTime": 1616444440.9650526, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864724427625868, "count": 1, "min": 0.6864724427625868, "max": 0.6864724427625868}}} [03/22/2021 20:20:40 INFO 140710537553728] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.16985383477105034 [2021-03-22 20:20:42.079] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 8, "duration": 1100, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444442.8025148, "EndTime": 1616444442.8025846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16682747595061093, "count": 1, "min": 0.16682747595061093, "max": 0.16682747595061093}}} #metrics {"StartTime": 1616444442.8026555, "EndTime": 1616444442.8026662, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553768616101622, "count": 1, "min": 0.1553768616101622, "max": 0.1553768616101622}}} #metrics {"StartTime": 1616444442.802698, "EndTime": 1616444442.8027058, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16974686173781955, "count": 1, "min": 0.16974686173781955, "max": 0.16974686173781955}}} #metrics {"StartTime": 1616444442.8027356, "EndTime": 1616444442.8027432, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15625149840388247, "count": 1, "min": 0.15625149840388247, "max": 0.15625149840388247}}} #metrics {"StartTime": 1616444442.8027785, "EndTime": 1616444442.8027873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410525408750395, "count": 1, "min": 0.1410525408750395, "max": 0.1410525408750395}}} #metrics {"StartTime": 1616444442.8028173, "EndTime": 1616444442.8028264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14302831537782332, "count": 1, "min": 0.14302831537782332, "max": 0.14302831537782332}}} #metrics {"StartTime": 1616444442.802863, "EndTime": 1616444442.8028696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101080976523087, "count": 1, "min": 0.14101080976523087, "max": 0.14101080976523087}}} #metrics {"StartTime": 1616444442.802895, "EndTime": 1616444442.8029037, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14302052668229218, "count": 1, "min": 0.14302052668229218, "max": 0.14302052668229218}}} #metrics {"StartTime": 1616444442.8029375, "EndTime": 1616444442.8029451, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18182365007385287, "count": 1, "min": 0.18182365007385287, "max": 0.18182365007385287}}} #metrics {"StartTime": 1616444442.8029718, "EndTime": 1616444442.802981, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17588854768247877, "count": 1, "min": 0.17588854768247877, "max": 0.17588854768247877}}} #metrics {"StartTime": 1616444442.8030062, "EndTime": 1616444442.8030148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18074517066499454, "count": 1, "min": 0.18074517066499454, "max": 0.18074517066499454}}} #metrics {"StartTime": 1616444442.8030498, "EndTime": 1616444442.8030581, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17560231099002682, "count": 1, "min": 0.17560231099002682, "max": 0.17560231099002682}}} #metrics {"StartTime": 1616444442.803083, "EndTime": 1616444442.8030913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743325014031481, "count": 1, "min": 0.1743325014031481, "max": 0.1743325014031481}}} #metrics {"StartTime": 1616444442.8031218, "EndTime": 1616444442.8031313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.175159344580953, "count": 1, "min": 0.175159344580953, "max": 0.175159344580953}}} #metrics {"StartTime": 1616444442.8031564, "EndTime": 1616444442.8031638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17434204288338523, "count": 1, "min": 0.17434204288338523, "max": 0.17434204288338523}}} #metrics {"StartTime": 1616444442.8031921, "EndTime": 1616444442.8031976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17518125530335632, "count": 1, "min": 0.17518125530335632, "max": 0.17518125530335632}}} #metrics {"StartTime": 1616444442.8032303, "EndTime": 1616444442.8032386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493836239633227, "count": 1, "min": 0.4493836239633227, "max": 0.4493836239633227}}} #metrics {"StartTime": 1616444442.8032672, "EndTime": 1616444442.803273, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498509646434828, "count": 1, "min": 0.4498509646434828, "max": 0.4498509646434828}}} #metrics {"StartTime": 1616444442.8033063, "EndTime": 1616444442.803315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493866889849398, "count": 1, "min": 0.4493866889849398, "max": 0.4493866889849398}}} #metrics {"StartTime": 1616444442.8033438, "EndTime": 1616444442.8033495, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44985619951525285, "count": 1, "min": 0.44985619951525285, "max": 0.44985619951525285}}} #metrics {"StartTime": 1616444442.80338, "EndTime": 1616444442.8033876, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4557540476692258, "count": 1, "min": 0.4557540476692258, "max": 0.4557540476692258}}} #metrics {"StartTime": 1616444442.803415, "EndTime": 1616444442.8034225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493456735115261, "count": 1, "min": 0.4493456735115261, "max": 0.4493456735115261}}} #metrics {"StartTime": 1616444442.8034527, "EndTime": 1616444442.8034618, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45601390915092943, "count": 1, "min": 0.45601390915092943, "max": 0.45601390915092943}}} #metrics {"StartTime": 1616444442.8034925, "EndTime": 1616444442.803499, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44944974700673285, "count": 1, "min": 0.44944974700673285, "max": 0.44944974700673285}}} #metrics {"StartTime": 1616444442.8035183, "EndTime": 1616444442.803523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846063797622364, "count": 1, "min": 0.6846063797622364, "max": 0.6846063797622364}}} #metrics {"StartTime": 1616444442.8035426, "EndTime": 1616444442.8035505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846835529083095, "count": 1, "min": 0.6846835529083095, "max": 0.6846835529083095}}} #metrics {"StartTime": 1616444442.8035786, "EndTime": 1616444442.8035853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684708249571054, "count": 1, "min": 0.684708249571054, "max": 0.684708249571054}}} #metrics {"StartTime": 1616444442.8036108, "EndTime": 1616444442.8036191, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845976291701835, "count": 1, "min": 0.6845976291701835, "max": 0.6845976291701835}}} #metrics {"StartTime": 1616444442.8036482, "EndTime": 1616444442.8036556, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6881677020879762, "count": 1, "min": 0.6881677020879762, "max": 0.6881677020879762}}} #metrics {"StartTime": 1616444442.8036873, "EndTime": 1616444442.8036964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6878732651160164, "count": 1, "min": 0.6878732651160164, "max": 0.6878732651160164}}} #metrics {"StartTime": 1616444442.8037322, "EndTime": 1616444442.8037417, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6883786626290996, "count": 1, "min": 0.6883786626290996, "max": 0.6883786626290996}}} #metrics {"StartTime": 1616444442.8037784, "EndTime": 1616444442.803787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6890521071323884, "count": 1, "min": 0.6890521071323884, "max": 0.6890521071323884}}} [03/22/2021 20:20:42 INFO 140710537553728] #quality_metric: host=algo-1, epoch=2, validation binary_classification_cross_entropy_objective <loss>=0.16682747595061093 [03/22/2021 20:20:42 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:20:42 INFO 140710537553728] Epoch 2: Loss improved. Updating best model [03/22/2021 20:20:42 INFO 140710537553728] Saving model for epoch: 2 [03/22/2021 20:20:42 INFO 140710537553728] Saved checkpoint to "/tmp/tmp3hzebq22/mx-mod-0000.params" [03/22/2021 20:20:42 INFO 140710537553728] #progress_metric: host=algo-1, completed 20.0 % of epochs #metrics {"StartTime": 1616444430.7835565, "EndTime": 1616444442.8096976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1364883.0, "count": 1, "min": 1364883, "max": 1364883}, "Total Batches Seen": {"sum": 1365.0, "count": 1, "min": 1365, "max": 1365}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:20:42 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=37497.96822833699 records/second [2021-03-22 20:20:53.153] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 9, "duration": 10341, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444453.1537085, "EndTime": 1616444453.1537905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16351999060736763, "count": 1, "min": 0.16351999060736763, "max": 0.16351999060736763}}} #metrics {"StartTime": 1616444453.1538746, "EndTime": 1616444453.15389, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15173084092881944, "count": 1, "min": 0.15173084092881944, "max": 0.15173084092881944}}} #metrics {"StartTime": 1616444453.1539328, "EndTime": 1616444453.1539445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16620086049397786, "count": 1, "min": 0.16620086049397786, "max": 0.16620086049397786}}} #metrics {"StartTime": 1616444453.1539824, "EndTime": 1616444453.153992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15253453828599717, "count": 1, "min": 0.15253453828599717, "max": 0.15253453828599717}}} #metrics {"StartTime": 1616444453.1540258, "EndTime": 1616444453.1540372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13938125005086263, "count": 1, "min": 0.13938125005086263, "max": 0.13938125005086263}}} #metrics {"StartTime": 1616444453.154082, "EndTime": 1616444453.1540923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14196454262627495, "count": 1, "min": 0.14196454262627495, "max": 0.14196454262627495}}} #metrics {"StartTime": 1616444453.1541345, "EndTime": 1616444453.1541455, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13936803158230252, "count": 1, "min": 0.13936803158230252, "max": 0.13936803158230252}}} #metrics {"StartTime": 1616444453.1541905, "EndTime": 1616444453.1542015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14195914394802517, "count": 1, "min": 0.14195914394802517, "max": 0.14195914394802517}}} #metrics {"StartTime": 1616444453.154246, "EndTime": 1616444453.154257, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17933889004177517, "count": 1, "min": 0.17933889004177517, "max": 0.17933889004177517}}} #metrics {"StartTime": 1616444453.1543012, "EndTime": 1616444453.154312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1743010859849718, "count": 1, "min": 0.1743010859849718, "max": 0.1743010859849718}}} #metrics {"StartTime": 1616444453.1543527, "EndTime": 1616444453.1543627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17841957187228732, "count": 1, "min": 0.17841957187228732, "max": 0.17841957187228732}}} #metrics {"StartTime": 1616444453.1543994, "EndTime": 1616444453.1544096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17412190558539498, "count": 1, "min": 0.17412190558539498, "max": 0.17412190558539498}}} #metrics {"StartTime": 1616444453.1544468, "EndTime": 1616444453.154457, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17391994750976564, "count": 1, "min": 0.17391994750976564, "max": 0.17391994750976564}}} #metrics {"StartTime": 1616444453.1544938, "EndTime": 1616444453.1545038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1754251917860243, "count": 1, "min": 0.1754251917860243, "max": 0.1754251917860243}}} #metrics {"StartTime": 1616444453.1545417, "EndTime": 1616444453.1545515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17391513987223306, "count": 1, "min": 0.17391513987223306, "max": 0.17391513987223306}}} #metrics {"StartTime": 1616444453.154588, "EndTime": 1616444453.1545975, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17545422559950086, "count": 1, "min": 0.17545422559950086, "max": 0.17545422559950086}}} #metrics {"StartTime": 1616444453.1546311, "EndTime": 1616444453.1546407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477140725368924, "count": 1, "min": 0.4477140725368924, "max": 0.4477140725368924}}} #metrics {"StartTime": 1616444453.154678, "EndTime": 1616444453.154688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478183336046007, "count": 1, "min": 0.4478183336046007, "max": 0.4478183336046007}}} #metrics {"StartTime": 1616444453.1547244, "EndTime": 1616444453.1547346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477149871826172, "count": 1, "min": 0.4477149871826172, "max": 0.4477149871826172}}} #metrics {"StartTime": 1616444453.1547716, "EndTime": 1616444453.1547809, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44781644015842015, "count": 1, "min": 0.44781644015842015, "max": 0.44781644015842015}}} #metrics {"StartTime": 1616444453.154819, "EndTime": 1616444453.154829, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4481405064561632, "count": 1, "min": 0.4481405064561632, "max": 0.4481405064561632}}} #metrics {"StartTime": 1616444453.1548698, "EndTime": 1616444453.1548798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44908387234157987, "count": 1, "min": 0.44908387234157987, "max": 0.44908387234157987}}} #metrics {"StartTime": 1616444453.1549199, "EndTime": 1616444453.1549304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4481378232828776, "count": 1, "min": 0.4481378232828776, "max": 0.4481378232828776}}} #metrics {"StartTime": 1616444453.1549714, "EndTime": 1616444453.1549826, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.449083447265625, "count": 1, "min": 0.449083447265625, "max": 0.449083447265625}}} #metrics {"StartTime": 1616444453.1550221, "EndTime": 1616444453.1550336, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684769345703125, "count": 1, "min": 0.684769345703125, "max": 0.684769345703125}}} #metrics {"StartTime": 1616444453.1550725, "EndTime": 1616444453.1550834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848677720811632, "count": 1, "min": 0.6848677720811632, "max": 0.6848677720811632}}} #metrics {"StartTime": 1616444453.1551228, "EndTime": 1616444453.1551335, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847689420572917, "count": 1, "min": 0.6847689420572917, "max": 0.6847689420572917}}} #metrics {"StartTime": 1616444453.1551733, "EndTime": 1616444453.1551843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694723849826, "count": 1, "min": 0.6848694723849826, "max": 0.6848694723849826}}} #metrics {"StartTime": 1616444453.1552236, "EndTime": 1616444453.1552346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6852227697753906, "count": 1, "min": 0.6852227697753906, "max": 0.6852227697753906}}} #metrics {"StartTime": 1616444453.1552744, "EndTime": 1616444453.1552844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686512747124566, "count": 1, "min": 0.686512747124566, "max": 0.686512747124566}}} #metrics {"StartTime": 1616444453.1553237, "EndTime": 1616444453.1553345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685223203531901, "count": 1, "min": 0.685223203531901, "max": 0.685223203531901}}} #metrics {"StartTime": 1616444453.1553738, "EndTime": 1616444453.1553845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865094029405382, "count": 1, "min": 0.6865094029405382, "max": 0.6865094029405382}}} [03/22/2021 20:20:53 INFO 140710537553728] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.16351999060736763 [2021-03-22 20:20:54.133] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 11, "duration": 964, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444454.8293853, "EndTime": 1616444454.8294492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16250319346396958, "count": 1, "min": 0.16250319346396958, "max": 0.16250319346396958}}} #metrics {"StartTime": 1616444454.8295212, "EndTime": 1616444454.8295317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15066525207378773, "count": 1, "min": 0.15066525207378773, "max": 0.15066525207378773}}} #metrics {"StartTime": 1616444454.8295643, "EndTime": 1616444454.8295712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16488659939741399, "count": 1, "min": 0.16488659939741399, "max": 0.16488659939741399}}} #metrics {"StartTime": 1616444454.8295968, "EndTime": 1616444454.8296049, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15133823687797196, "count": 1, "min": 0.15133823687797196, "max": 0.15133823687797196}}} #metrics {"StartTime": 1616444454.8296409, "EndTime": 1616444454.8296502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144501536370846, "count": 1, "min": 0.14144501536370846, "max": 0.14144501536370846}}} #metrics {"StartTime": 1616444454.8296835, "EndTime": 1616444454.8296895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14305454800267242, "count": 1, "min": 0.14305454800267242, "max": 0.14305454800267242}}} #metrics {"StartTime": 1616444454.8297236, "EndTime": 1616444454.8297322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414434523326149, "count": 1, "min": 0.1414434523326149, "max": 0.1414434523326149}}} #metrics {"StartTime": 1616444454.8297665, "EndTime": 1616444454.829774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.143045495320703, "count": 1, "min": 0.143045495320703, "max": 0.143045495320703}}} #metrics {"StartTime": 1616444454.8298037, "EndTime": 1616444454.82981, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17906154181192968, "count": 1, "min": 0.17906154181192968, "max": 0.17906154181192968}}} #metrics {"StartTime": 1616444454.8298419, "EndTime": 1616444454.8298495, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17453878394927627, "count": 1, "min": 0.17453878394927627, "max": 0.17453878394927627}}} #metrics {"StartTime": 1616444454.8298814, "EndTime": 1616444454.82989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17828867264159376, "count": 1, "min": 0.17828867264159376, "max": 0.17828867264159376}}} #metrics {"StartTime": 1616444454.8299239, "EndTime": 1616444454.82993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17445727678738482, "count": 1, "min": 0.17445727678738482, "max": 0.17445727678738482}}} #metrics {"StartTime": 1616444454.8299549, "EndTime": 1616444454.8299623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427007341207248, "count": 1, "min": 0.17427007341207248, "max": 0.17427007341207248}}} #metrics {"StartTime": 1616444454.8299973, "EndTime": 1616444454.8300066, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1750567582559983, "count": 1, "min": 0.1750567582559983, "max": 0.1750567582559983}}} #metrics {"StartTime": 1616444454.8300416, "EndTime": 1616444454.8300512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17428193632880065, "count": 1, "min": 0.17428193632880065, "max": 0.17428193632880065}}} #metrics {"StartTime": 1616444454.8300867, "EndTime": 1616444454.8300965, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17501217630794755, "count": 1, "min": 0.17501217630794755, "max": 0.17501217630794755}}} #metrics {"StartTime": 1616444454.830131, "EndTime": 1616444454.83014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494643696745554, "count": 1, "min": 0.4494643696745554, "max": 0.4494643696745554}}} #metrics {"StartTime": 1616444454.8301692, "EndTime": 1616444454.8301766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497854132971189, "count": 1, "min": 0.4497854132971189, "max": 0.4497854132971189}}} #metrics {"StartTime": 1616444454.8302052, "EndTime": 1616444454.8302143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494527105196414, "count": 1, "min": 0.4494527105196414, "max": 0.4494527105196414}}} #metrics {"StartTime": 1616444454.8302486, "EndTime": 1616444454.830258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497524115978794, "count": 1, "min": 0.4497524115978794, "max": 0.4497524115978794}}} #metrics {"StartTime": 1616444454.8302896, "EndTime": 1616444454.8302958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4416746341528697, "count": 1, "min": 0.4416746341528697, "max": 0.4416746341528697}}} #metrics {"StartTime": 1616444454.8303156, "EndTime": 1616444454.830321, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449470298053822, "count": 1, "min": 0.449470298053822, "max": 0.449470298053822}}} #metrics {"StartTime": 1616444454.8303466, "EndTime": 1616444454.830356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44170053646838137, "count": 1, "min": 0.44170053646838137, "max": 0.44170053646838137}}} #metrics {"StartTime": 1616444454.83039, "EndTime": 1616444454.8303998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44953030052814413, "count": 1, "min": 0.44953030052814413, "max": 0.44953030052814413}}} #metrics {"StartTime": 1616444454.8304358, "EndTime": 1616444454.830445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845725611209108, "count": 1, "min": 0.6845725611209108, "max": 0.6845725611209108}}} #metrics {"StartTime": 1616444454.830479, "EndTime": 1616444454.8304877, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846288066902587, "count": 1, "min": 0.6846288066902587, "max": 0.6846288066902587}}} #metrics {"StartTime": 1616444454.830525, "EndTime": 1616444454.8305357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846486452815591, "count": 1, "min": 0.6846486452815591, "max": 0.6846486452815591}}} #metrics {"StartTime": 1616444454.8305712, "EndTime": 1616444454.83058, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846265196313837, "count": 1, "min": 0.6846265196313837, "max": 0.6846265196313837}}} #metrics {"StartTime": 1616444454.8306146, "EndTime": 1616444454.8306234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6859787027908171, "count": 1, "min": 0.6859787027908171, "max": 0.6859787027908171}}} #metrics {"StartTime": 1616444454.8306544, "EndTime": 1616444454.8306637, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858253109512207, "count": 1, "min": 0.6858253109512207, "max": 0.6858253109512207}}} #metrics {"StartTime": 1616444454.830698, "EndTime": 1616444454.8307078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858306668213714, "count": 1, "min": 0.6858306668213714, "max": 0.6858306668213714}}} #metrics {"StartTime": 1616444454.8307412, "EndTime": 1616444454.8307505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6870177212982963, "count": 1, "min": 0.6870177212982963, "max": 0.6870177212982963}}} [03/22/2021 20:20:54 INFO 140710537553728] #quality_metric: host=algo-1, epoch=3, validation binary_classification_cross_entropy_objective <loss>=0.16250319346396958 [03/22/2021 20:20:54 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:20:54 INFO 140710537553728] Epoch 3: Loss improved. Updating best model [03/22/2021 20:20:54 INFO 140710537553728] Saving model for epoch: 3 [03/22/2021 20:20:54 INFO 140710537553728] Saved checkpoint to "/tmp/tmpcktaf0t9/mx-mod-0000.params" [03/22/2021 20:20:54 INFO 140710537553728] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs #metrics {"StartTime": 1616444442.8123255, "EndTime": 1616444454.8358548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1815844.0, "count": 1, "min": 1815844, "max": 1815844}, "Total Batches Seen": {"sum": 1816.0, "count": 1, "min": 1816, "max": 1816}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:20:54 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=37506.16514865714 records/second [2021-03-22 20:21:06.261] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 11, "duration": 11423, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444466.2616825, "EndTime": 1616444466.2617717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16011860497368707, "count": 1, "min": 0.16011860497368707, "max": 0.16011860497368707}}} #metrics {"StartTime": 1616444466.2618694, "EndTime": 1616444466.262004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1480200882297092, "count": 1, "min": 0.1480200882297092, "max": 0.1480200882297092}}} #metrics {"StartTime": 1616444466.2620666, "EndTime": 1616444466.2620819, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16250615156385634, "count": 1, "min": 0.16250615156385634, "max": 0.16250615156385634}}} #metrics {"StartTime": 1616444466.2621212, "EndTime": 1616444466.2621312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14865621285332573, "count": 1, "min": 0.14865621285332573, "max": 0.14865621285332573}}} #metrics {"StartTime": 1616444466.2621677, "EndTime": 1616444466.2621765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1390991103447808, "count": 1, "min": 0.1390991103447808, "max": 0.1390991103447808}}} #metrics {"StartTime": 1616444466.2622092, "EndTime": 1616444466.2622178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14186613374498155, "count": 1, "min": 0.14186613374498155, "max": 0.14186613374498155}}} #metrics {"StartTime": 1616444466.262252, "EndTime": 1616444466.262261, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13909598729451497, "count": 1, "min": 0.13909598729451497, "max": 0.13909598729451497}}} #metrics {"StartTime": 1616444466.2622943, "EndTime": 1616444466.2623024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14186234000311956, "count": 1, "min": 0.14186234000311956, "max": 0.14186234000311956}}} #metrics {"StartTime": 1616444466.2623334, "EndTime": 1616444466.262342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17732769507514107, "count": 1, "min": 0.17732769507514107, "max": 0.17732769507514107}}} #metrics {"StartTime": 1616444466.2623758, "EndTime": 1616444466.262385, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357961480034723, "count": 1, "min": 0.17357961480034723, "max": 0.17357961480034723}}} #metrics {"StartTime": 1616444466.2624168, "EndTime": 1616444466.262425, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1766369975789388, "count": 1, "min": 0.1766369975789388, "max": 0.1766369975789388}}} #metrics {"StartTime": 1616444466.2624724, "EndTime": 1616444466.262481, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17352985107421875, "count": 1, "min": 0.17352985107421875, "max": 0.17352985107421875}}} #metrics {"StartTime": 1616444466.2625039, "EndTime": 1616444466.262509, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17371945292154947, "count": 1, "min": 0.17371945292154947, "max": 0.17371945292154947}}} #metrics {"StartTime": 1616444466.2625327, "EndTime": 1616444466.2625377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17538380445692275, "count": 1, "min": 0.17538380445692275, "max": 0.17538380445692275}}} #metrics {"StartTime": 1616444466.2625563, "EndTime": 1616444466.2625613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17371811465793185, "count": 1, "min": 0.17371811465793185, "max": 0.17371811465793185}}} #metrics {"StartTime": 1616444466.2625792, "EndTime": 1616444466.262584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17539858140733508, "count": 1, "min": 0.17539858140733508, "max": 0.17539858140733508}}} #metrics {"StartTime": 1616444466.2626045, "EndTime": 1616444466.2626112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44769561041937933, "count": 1, "min": 0.44769561041937933, "max": 0.44769561041937933}}} #metrics {"StartTime": 1616444466.262639, "EndTime": 1616444466.2626472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780998006184897, "count": 1, "min": 0.44780998006184897, "max": 0.44780998006184897}}} #metrics {"StartTime": 1616444466.2626784, "EndTime": 1616444466.2626863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44769591668023, "count": 1, "min": 0.44769591668023, "max": 0.44769591668023}}} #metrics {"StartTime": 1616444466.262715, "EndTime": 1616444466.2627234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780866421169707, "count": 1, "min": 0.44780866421169707, "max": 0.44780866421169707}}} #metrics {"StartTime": 1616444466.262743, "EndTime": 1616444466.2627482, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44802510172526044, "count": 1, "min": 0.44802510172526044, "max": 0.44802510172526044}}} #metrics {"StartTime": 1616444466.2627664, "EndTime": 1616444466.2627711, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44900562900119356, "count": 1, "min": 0.44900562900119356, "max": 0.44900562900119356}}} #metrics {"StartTime": 1616444466.2628002, "EndTime": 1616444466.2628078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44802702582465276, "count": 1, "min": 0.44802702582465276, "max": 0.44802702582465276}}} #metrics {"StartTime": 1616444466.2628396, "EndTime": 1616444466.2628477, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.449005888671875, "count": 1, "min": 0.449005888671875, "max": 0.449005888671875}}} #metrics {"StartTime": 1616444466.2628791, "EndTime": 1616444466.262887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847551501464844, "count": 1, "min": 0.6847551501464844, "max": 0.6847551501464844}}} #metrics {"StartTime": 1616444466.262908, "EndTime": 1616444466.262913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848608039008246, "count": 1, "min": 0.6848608039008246, "max": 0.6848608039008246}}} #metrics {"StartTime": 1616444466.2629366, "EndTime": 1616444466.2629442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684755345594618, "count": 1, "min": 0.684755345594618, "max": 0.684755345594618}}} #metrics {"StartTime": 1616444466.2629762, "EndTime": 1616444466.2629845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848622878689236, "count": 1, "min": 0.6848622878689236, "max": 0.6848622878689236}}} #metrics {"StartTime": 1616444466.2630134, "EndTime": 1616444466.263019, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685145560438368, "count": 1, "min": 0.685145560438368, "max": 0.685145560438368}}} #metrics {"StartTime": 1616444466.2630374, "EndTime": 1616444466.2630422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865761603461371, "count": 1, "min": 0.6865761603461371, "max": 0.6865761603461371}}} #metrics {"StartTime": 1616444466.2630606, "EndTime": 1616444466.263065, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851455788845486, "count": 1, "min": 0.6851455788845486, "max": 0.6851455788845486}}} #metrics {"StartTime": 1616444466.2630906, "EndTime": 1616444466.2630973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865822210015191, "count": 1, "min": 0.6865822210015191, "max": 0.6865822210015191}}} [03/22/2021 20:21:06 INFO 140710537553728] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.16011860497368707 [2021-03-22 20:21:07.506] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 14, "duration": 1226, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444468.199134, "EndTime": 1616444468.1991992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15993249969996734, "count": 1, "min": 0.15993249969996734, "max": 0.15993249969996734}}} #metrics {"StartTime": 1616444468.1992693, "EndTime": 1616444468.1992795, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14792189883153786, "count": 1, "min": 0.14792189883153786, "max": 0.14792189883153786}}} #metrics {"StartTime": 1616444468.199307, "EndTime": 1616444468.1993144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16214593349671308, "count": 1, "min": 0.16214593349671308, "max": 0.16214593349671308}}} #metrics {"StartTime": 1616444468.1993492, "EndTime": 1616444468.1993577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14846924596884287, "count": 1, "min": 0.14846924596884287, "max": 0.14846924596884287}}} #metrics {"StartTime": 1616444468.1993904, "EndTime": 1616444468.199398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14061785689985495, "count": 1, "min": 0.14061785689985495, "max": 0.14061785689985495}}} #metrics {"StartTime": 1616444468.1994283, "EndTime": 1616444468.199437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14286178810832897, "count": 1, "min": 0.14286178810832897, "max": 0.14286178810832897}}} #metrics {"StartTime": 1616444468.199473, "EndTime": 1616444468.1994827, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14061601390774334, "count": 1, "min": 0.14061601390774334, "max": 0.14061601390774334}}} #metrics {"StartTime": 1616444468.1995213, "EndTime": 1616444468.199531, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14285470834961803, "count": 1, "min": 0.14285470834961803, "max": 0.14285470834961803}}} #metrics {"StartTime": 1616444468.1995661, "EndTime": 1616444468.199573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17764126309186237, "count": 1, "min": 0.17764126309186237, "max": 0.17764126309186237}}} #metrics {"StartTime": 1616444468.1995947, "EndTime": 1616444468.1996005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742170847834732, "count": 1, "min": 0.1742170847834732, "max": 0.1742170847834732}}} #metrics {"StartTime": 1616444468.199625, "EndTime": 1616444468.1996322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17703848556781124, "count": 1, "min": 0.17703848556781124, "max": 0.17703848556781124}}} #metrics {"StartTime": 1616444468.1996667, "EndTime": 1616444468.1996737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420216171754596, "count": 1, "min": 0.17420216171754596, "max": 0.17420216171754596}}} #metrics {"StartTime": 1616444468.1996992, "EndTime": 1616444468.199707, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17477232997502465, "count": 1, "min": 0.17477232997502465, "max": 0.17477232997502465}}} #metrics {"StartTime": 1616444468.1997433, "EndTime": 1616444468.1997519, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17488470099508202, "count": 1, "min": 0.17488470099508202, "max": 0.17488470099508202}}} #metrics {"StartTime": 1616444468.199784, "EndTime": 1616444468.199792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17476032102110117, "count": 1, "min": 0.17476032102110117, "max": 0.17476032102110117}}} #metrics {"StartTime": 1616444468.1998236, "EndTime": 1616444468.1998327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1748245813120378, "count": 1, "min": 0.1748245813120378, "max": 0.1748245813120378}}} #metrics {"StartTime": 1616444468.1998682, "EndTime": 1616444468.1998773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44963008819033284, "count": 1, "min": 0.44963008819033284, "max": 0.44963008819033284}}} #metrics {"StartTime": 1616444468.1999092, "EndTime": 1616444468.1999176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497361796786647, "count": 1, "min": 0.4497361796786647, "max": 0.4497361796786647}}} #metrics {"StartTime": 1616444468.1999528, "EndTime": 1616444468.1999617, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44964868891676923, "count": 1, "min": 0.44964868891676923, "max": 0.44964868891676923}}} #metrics {"StartTime": 1616444468.199987, "EndTime": 1616444468.199993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44972502508970447, "count": 1, "min": 0.44972502508970447, "max": 0.44972502508970447}}} #metrics {"StartTime": 1616444468.2000144, "EndTime": 1616444468.2000222, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4432960132641511, "count": 1, "min": 0.4432960132641511, "max": 0.4432960132641511}}} #metrics {"StartTime": 1616444468.2000506, "EndTime": 1616444468.200059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500570051251774, "count": 1, "min": 0.4500570051251774, "max": 0.4500570051251774}}} #metrics {"StartTime": 1616444468.200092, "EndTime": 1616444468.2001011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4431988142093742, "count": 1, "min": 0.4431988142093742, "max": 0.4431988142093742}}} #metrics {"StartTime": 1616444468.2001336, "EndTime": 1616444468.2001424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500859499950453, "count": 1, "min": 0.4500859499950453, "max": 0.4500859499950453}}} #metrics {"StartTime": 1616444468.2001717, "EndTime": 1616444468.2001805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845708925884328, "count": 1, "min": 0.6845708925884328, "max": 0.6845708925884328}}} #metrics {"StartTime": 1616444468.200214, "EndTime": 1616444468.2002234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684751463587749, "count": 1, "min": 0.684751463587749, "max": 0.684751463587749}}} #metrics {"StartTime": 1616444468.2002566, "EndTime": 1616444468.2002645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847096641964157, "count": 1, "min": 0.6847096641964157, "max": 0.6847096641964157}}} #metrics {"StartTime": 1616444468.2003117, "EndTime": 1616444468.2003214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847314679963127, "count": 1, "min": 0.6847314679963127, "max": 0.6847314679963127}}} #metrics {"StartTime": 1616444468.2003553, "EndTime": 1616444468.2003648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850177228249873, "count": 1, "min": 0.6850177228249873, "max": 0.6850177228249873}}} #metrics {"StartTime": 1616444468.2004004, "EndTime": 1616444468.2004104, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834116065631167, "count": 1, "min": 0.6834116065631167, "max": 0.6834116065631167}}} #metrics {"StartTime": 1616444468.2004368, "EndTime": 1616444468.2004452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849771637347271, "count": 1, "min": 0.6849771637347271, "max": 0.6849771637347271}}} #metrics {"StartTime": 1616444468.200477, "EndTime": 1616444468.2004862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834691728284348, "count": 1, "min": 0.6834691728284348, "max": 0.6834691728284348}}} [03/22/2021 20:21:08 INFO 140710537553728] #quality_metric: host=algo-1, epoch=4, validation binary_classification_cross_entropy_objective <loss>=0.15993249969996734 [03/22/2021 20:21:08 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:21:08 INFO 140710537553728] Epoch 4: Loss improved. Updating best model [03/22/2021 20:21:08 INFO 140710537553728] Saving model for epoch: 4 [03/22/2021 20:21:08 INFO 140710537553728] Saved checkpoint to "/tmp/tmp5fpoxe7w/mx-mod-0000.params" [03/22/2021 20:21:08 INFO 140710537553728] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs #metrics {"StartTime": 1616444454.8381793, "EndTime": 1616444468.205608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2266805.0, "count": 1, "min": 2266805, "max": 2266805}, "Total Batches Seen": {"sum": 2267.0, "count": 1, "min": 2267, "max": 2267}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:21:08 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=33735.5286079608 records/second [2021-03-22 20:21:18.490] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 13, "duration": 10284, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444478.4904928, "EndTime": 1616444478.4905806, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15805759214613171, "count": 1, "min": 0.15805759214613171, "max": 0.15805759214613171}}} #metrics {"StartTime": 1616444478.4906716, "EndTime": 1616444478.4906883, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14571451383802625, "count": 1, "min": 0.14571451383802625, "max": 0.14571451383802625}}} #metrics {"StartTime": 1616444478.490728, "EndTime": 1616444478.4907393, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16025175557454427, "count": 1, "min": 0.16025175557454427, "max": 0.16025175557454427}}} #metrics {"StartTime": 1616444478.4907742, "EndTime": 1616444478.4907854, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14624173316107855, "count": 1, "min": 0.14624173316107855, "max": 0.14624173316107855}}} #metrics {"StartTime": 1616444478.490823, "EndTime": 1616444478.4908319, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885277981228297, "count": 1, "min": 0.13885277981228297, "max": 0.13885277981228297}}} #metrics {"StartTime": 1616444478.4908667, "EndTime": 1616444478.4908757, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14174166376749675, "count": 1, "min": 0.14174166376749675, "max": 0.14174166376749675}}} #metrics {"StartTime": 1616444478.4909081, "EndTime": 1616444478.490918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885016257392035, "count": 1, "min": 0.13885016257392035, "max": 0.13885016257392035}}} #metrics {"StartTime": 1616444478.4909525, "EndTime": 1616444478.490963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14173942221747504, "count": 1, "min": 0.14173942221747504, "max": 0.14173942221747504}}} #metrics {"StartTime": 1616444478.4909992, "EndTime": 1616444478.491009, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17625278232150607, "count": 1, "min": 0.17625278232150607, "max": 0.17625278232150607}}} #metrics {"StartTime": 1616444478.491046, "EndTime": 1616444478.4910567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17342032857259115, "count": 1, "min": 0.17342032857259115, "max": 0.17342032857259115}}} #metrics {"StartTime": 1616444478.4910963, "EndTime": 1616444478.4911067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17569479922824435, "count": 1, "min": 0.17569479922824435, "max": 0.17569479922824435}}} #metrics {"StartTime": 1616444478.4911456, "EndTime": 1616444478.4911563, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17340999786376954, "count": 1, "min": 0.17340999786376954, "max": 0.17340999786376954}}} #metrics {"StartTime": 1616444478.491195, "EndTime": 1616444478.4912055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357845387776694, "count": 1, "min": 0.17357845387776694, "max": 0.17357845387776694}}} #metrics {"StartTime": 1616444478.4912477, "EndTime": 1616444478.4912584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17534690131293404, "count": 1, "min": 0.17534690131293404, "max": 0.17534690131293404}}} #metrics {"StartTime": 1616444478.4912999, "EndTime": 1616444478.4913108, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735776296318902, "count": 1, "min": 0.1735776296318902, "max": 0.1735776296318902}}} #metrics {"StartTime": 1616444478.4913504, "EndTime": 1616444478.4913614, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17535195502387152, "count": 1, "min": 0.17535195502387152, "max": 0.17535195502387152}}} #metrics {"StartTime": 1616444478.4914014, "EndTime": 1616444478.4914124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768710361056857, "count": 1, "min": 0.44768710361056857, "max": 0.44768710361056857}}} #metrics {"StartTime": 1616444478.49145, "EndTime": 1616444478.49146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780308024088544, "count": 1, "min": 0.44780308024088544, "max": 0.44780308024088544}}} #metrics {"StartTime": 1616444478.4914975, "EndTime": 1616444478.4915078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768651909722224, "count": 1, "min": 0.44768651909722224, "max": 0.44768651909722224}}} #metrics {"StartTime": 1616444478.4915497, "EndTime": 1616444478.4915607, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478024911159939, "count": 1, "min": 0.4478024911159939, "max": 0.4478024911159939}}} #metrics {"StartTime": 1616444478.4916024, "EndTime": 1616444478.4916136, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478862040879991, "count": 1, "min": 0.4478862040879991, "max": 0.4478862040879991}}} #metrics {"StartTime": 1616444478.491653, "EndTime": 1616444478.4916651, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489593240017361, "count": 1, "min": 0.4489593240017361, "max": 0.4489593240017361}}} #metrics {"StartTime": 1616444478.491706, "EndTime": 1616444478.491717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478861860487196, "count": 1, "min": 0.4478861860487196, "max": 0.4478861860487196}}} #metrics {"StartTime": 1616444478.4917586, "EndTime": 1616444478.4917696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489597631157769, "count": 1, "min": 0.4489597631157769, "max": 0.4489597631157769}}} #metrics {"StartTime": 1616444478.4918075, "EndTime": 1616444478.4918184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847447676595052, "count": 1, "min": 0.6847447676595052, "max": 0.6847447676595052}}} #metrics {"StartTime": 1616444478.491859, "EndTime": 1616444478.4918706, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848555239529079, "count": 1, "min": 0.6848555239529079, "max": 0.6848555239529079}}} #metrics {"StartTime": 1616444478.491912, "EndTime": 1616444478.491923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847441625976562, "count": 1, "min": 0.6847441625976562, "max": 0.6847441625976562}}} #metrics {"StartTime": 1616444478.4919643, "EndTime": 1616444478.491975, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848577110460069, "count": 1, "min": 0.6848577110460069, "max": 0.6848577110460069}}} #metrics {"StartTime": 1616444478.4920056, "EndTime": 1616444478.4920151, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6849757615831163, "count": 1, "min": 0.6849757615831163, "max": 0.6849757615831163}}} #metrics {"StartTime": 1616444478.4920545, "EndTime": 1616444478.4920654, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865579337565104, "count": 1, "min": 0.6865579337565104, "max": 0.6865579337565104}}} #metrics {"StartTime": 1616444478.4921064, "EndTime": 1616444478.4921174, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6849756278483073, "count": 1, "min": 0.6849756278483073, "max": 0.6849756278483073}}} #metrics {"StartTime": 1616444478.4921508, "EndTime": 1616444478.49216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865599069552951, "count": 1, "min": 0.6865599069552951, "max": 0.6865599069552951}}} [03/22/2021 20:21:18 INFO 140710537553728] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.15805759214613171 [2021-03-22 20:21:19.581] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 17, "duration": 1074, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444480.25082, "EndTime": 1616444480.2508862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1583355314029073, "count": 1, "min": 0.1583355314029073, "max": 0.1583355314029073}}} #metrics {"StartTime": 1616444480.2509584, "EndTime": 1616444480.2509718, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14611494752221735, "count": 1, "min": 0.14611494752221735, "max": 0.14611494752221735}}} #metrics {"StartTime": 1616444480.2510066, "EndTime": 1616444480.2510164, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1603815512177537, "count": 1, "min": 0.1603815512177537, "max": 0.1603815512177537}}} #metrics {"StartTime": 1616444480.2510529, "EndTime": 1616444480.2510605, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14657433628084304, "count": 1, "min": 0.14657433628084304, "max": 0.14657433628084304}}} #metrics {"StartTime": 1616444480.251085, "EndTime": 1616444480.2510934, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14038594306646687, "count": 1, "min": 0.14038594306646687, "max": 0.14038594306646687}}} #metrics {"StartTime": 1616444480.2511272, "EndTime": 1616444480.2511358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14268820232928, "count": 1, "min": 0.14268820232928, "max": 0.14268820232928}}} #metrics {"StartTime": 1616444480.251166, "EndTime": 1616444480.2511754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14038611779679047, "count": 1, "min": 0.14038611779679047, "max": 0.14038611779679047}}} #metrics {"StartTime": 1616444480.251207, "EndTime": 1616444480.2512133, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14268452500713322, "count": 1, "min": 0.14268452500713322, "max": 0.14268452500713322}}} #metrics {"StartTime": 1616444480.2512321, "EndTime": 1616444480.2512372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17683866540442889, "count": 1, "min": 0.17683866540442889, "max": 0.17683866540442889}}} #metrics {"StartTime": 1616444480.2512555, "EndTime": 1616444480.2512598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415200071553083, "count": 1, "min": 0.17415200071553083, "max": 0.17415200071553083}}} #metrics {"StartTime": 1616444480.2512858, "EndTime": 1616444480.2512913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17633885425393708, "count": 1, "min": 0.17633885425393708, "max": 0.17633885425393708}}} #metrics {"StartTime": 1616444480.25131, "EndTime": 1616444480.2513146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415385548265264, "count": 1, "min": 0.17415385548265264, "max": 0.17415385548265264}}} #metrics {"StartTime": 1616444480.2513328, "EndTime": 1616444480.2513375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17447848892685622, "count": 1, "min": 0.17447848892685622, "max": 0.17447848892685622}}} #metrics {"StartTime": 1616444480.2513652, "EndTime": 1616444480.2513726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17472684926886878, "count": 1, "min": 0.17472684926886878, "max": 0.17472684926886878}}} #metrics {"StartTime": 1616444480.2514057, "EndTime": 1616444480.251414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17446946588542966, "count": 1, "min": 0.17446946588542966, "max": 0.17446946588542966}}} #metrics {"StartTime": 1616444480.2514493, "EndTime": 1616444480.2514594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1746727223892848, "count": 1, "min": 0.1746727223892848, "max": 0.1746727223892848}}} #metrics {"StartTime": 1616444480.2514882, "EndTime": 1616444480.251494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44949225398143683, "count": 1, "min": 0.44949225398143683, "max": 0.44949225398143683}}} #metrics {"StartTime": 1616444480.2515154, "EndTime": 1616444480.2515242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496848227687184, "count": 1, "min": 0.4496848227687184, "max": 0.4496848227687184}}} #metrics {"StartTime": 1616444480.2515566, "EndTime": 1616444480.2515655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4495299892347714, "count": 1, "min": 0.4495299892347714, "max": 0.4495299892347714}}} #metrics {"StartTime": 1616444480.2516015, "EndTime": 1616444480.25161, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496935963694119, "count": 1, "min": 0.4496935963694119, "max": 0.4496935963694119}}} #metrics {"StartTime": 1616444480.2516441, "EndTime": 1616444480.2516537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44691241746340443, "count": 1, "min": 0.44691241746340443, "max": 0.44691241746340443}}} #metrics {"StartTime": 1616444480.2516913, "EndTime": 1616444480.2517004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506013365064252, "count": 1, "min": 0.4506013365064252, "max": 0.4506013365064252}}} #metrics {"StartTime": 1616444480.2517376, "EndTime": 1616444480.251747, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44686130444504846, "count": 1, "min": 0.44686130444504846, "max": 0.44686130444504846}}} #metrics {"StartTime": 1616444480.251783, "EndTime": 1616444480.251792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45061278235770635, "count": 1, "min": 0.45061278235770635, "max": 0.45061278235770635}}} #metrics {"StartTime": 1616444480.2518287, "EndTime": 1616444480.251838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846427729350996, "count": 1, "min": 0.6846427729350996, "max": 0.6846427729350996}}} #metrics {"StartTime": 1616444480.251875, "EndTime": 1616444480.2518845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849058020298883, "count": 1, "min": 0.6849058020298883, "max": 0.6849058020298883}}} #metrics {"StartTime": 1616444480.2519178, "EndTime": 1616444480.2519243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847597207121335, "count": 1, "min": 0.6847597207121335, "max": 0.6847597207121335}}} #metrics {"StartTime": 1616444480.2519479, "EndTime": 1616444480.251955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849591125087661, "count": 1, "min": 0.6849591125087661, "max": 0.6849591125087661}}} #metrics {"StartTime": 1616444480.251982, "EndTime": 1616444480.2519906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847650684615875, "count": 1, "min": 0.6847650684615875, "max": 0.6847650684615875}}} #metrics {"StartTime": 1616444480.2520218, "EndTime": 1616444480.2520301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834993658493824, "count": 1, "min": 0.6834993658493824, "max": 0.6834993658493824}}} #metrics {"StartTime": 1616444480.2520633, "EndTime": 1616444480.2520728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846659672689581, "count": 1, "min": 0.6846659672689581, "max": 0.6846659672689581}}} #metrics {"StartTime": 1616444480.252104, "EndTime": 1616444480.2521129, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835336784997561, "count": 1, "min": 0.6835336784997561, "max": 0.6835336784997561}}} [03/22/2021 20:21:20 INFO 140710537553728] #quality_metric: host=algo-1, epoch=5, validation binary_classification_cross_entropy_objective <loss>=0.1583355314029073 [03/22/2021 20:21:20 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=sampled_accuracy, value=0.9504523682810007 [03/22/2021 20:21:20 INFO 140710537553728] Epoch 5: Loss improved. Updating best model [03/22/2021 20:21:20 INFO 140710537553728] Saving model for epoch: 5 [03/22/2021 20:21:20 INFO 140710537553728] Saved checkpoint to "/tmp/tmpqm59vqw1/mx-mod-0000.params" [03/22/2021 20:21:20 INFO 140710537553728] #progress_metric: host=algo-1, completed 40.0 % of epochs #metrics {"StartTime": 1616444468.205829, "EndTime": 1616444480.2572298, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2717766.0, "count": 1, "min": 2717766, "max": 2717766}, "Total Batches Seen": {"sum": 2718.0, "count": 1, "min": 2718, "max": 2718}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:21:20 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=37419.47554906382 records/second [2021-03-22 20:21:30.401] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 15, "duration": 10144, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444490.401905, "EndTime": 1616444490.4019735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15674167239718967, "count": 1, "min": 0.15674167239718967, "max": 0.15674167239718967}}} #metrics {"StartTime": 1616444490.4020524, "EndTime": 1616444490.4020665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1441272551642524, "count": 1, "min": 0.1441272551642524, "max": 0.1441272551642524}}} #metrics {"StartTime": 1616444490.4021125, "EndTime": 1616444490.402123, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1587956751844618, "count": 1, "min": 0.1587956751844618, "max": 0.1587956751844618}}} #metrics {"StartTime": 1616444490.4021606, "EndTime": 1616444490.4021714, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14457234027438692, "count": 1, "min": 0.14457234027438692, "max": 0.14457234027438692}}} #metrics {"StartTime": 1616444490.4022117, "EndTime": 1616444490.4022226, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870962710910373, "count": 1, "min": 0.13870962710910373, "max": 0.13870962710910373}}} #metrics {"StartTime": 1616444490.4022634, "EndTime": 1616444490.402274, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159801496717664, "count": 1, "min": 0.14159801496717664, "max": 0.14159801496717664}}} #metrics {"StartTime": 1616444490.402317, "EndTime": 1616444490.4023283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870781733194987, "count": 1, "min": 0.13870781733194987, "max": 0.13870781733194987}}} #metrics {"StartTime": 1616444490.40237, "EndTime": 1616444490.4023807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159739757961698, "count": 1, "min": 0.14159739757961698, "max": 0.14159739757961698}}} #metrics {"StartTime": 1616444490.4024212, "EndTime": 1616444490.402432, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17562180168999567, "count": 1, "min": 0.17562180168999567, "max": 0.17562180168999567}}} #metrics {"StartTime": 1616444490.4024732, "EndTime": 1616444490.4024837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338862867567276, "count": 1, "min": 0.17338862867567276, "max": 0.17338862867567276}}} #metrics {"StartTime": 1616444490.402525, "EndTime": 1616444490.402535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1751474491373698, "count": 1, "min": 0.1751474491373698, "max": 0.1751474491373698}}} #metrics {"StartTime": 1616444490.4025714, "EndTime": 1616444490.402582, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733892227511936, "count": 1, "min": 0.1733892227511936, "max": 0.1733892227511936}}} #metrics {"StartTime": 1616444490.4026232, "EndTime": 1616444490.4026341, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1734556071302626, "count": 1, "min": 0.1734556071302626, "max": 0.1734556071302626}}} #metrics {"StartTime": 1616444490.4026768, "EndTime": 1616444490.4026878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17531315551757812, "count": 1, "min": 0.17531315551757812, "max": 0.17531315551757812}}} #metrics {"StartTime": 1616444490.402728, "EndTime": 1616444490.4027395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17345546332465278, "count": 1, "min": 0.17345546332465278, "max": 0.17345546332465278}}} #metrics {"StartTime": 1616444490.4027686, "EndTime": 1616444490.402776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753152941555447, "count": 1, "min": 0.1753152941555447, "max": 0.1753152941555447}}} #metrics {"StartTime": 1616444490.4027975, "EndTime": 1616444490.4028034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768543226453994, "count": 1, "min": 0.44768543226453994, "max": 0.44768543226453994}}} #metrics {"StartTime": 1616444490.4028378, "EndTime": 1616444490.4028475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477956359185113, "count": 1, "min": 0.4477956359185113, "max": 0.4477956359185113}}} #metrics {"StartTime": 1616444490.4028885, "EndTime": 1616444490.4028995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476848393419054, "count": 1, "min": 0.4476848393419054, "max": 0.4476848393419054}}} #metrics {"StartTime": 1616444490.4029393, "EndTime": 1616444490.40295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477954655626085, "count": 1, "min": 0.4477954655626085, "max": 0.4477954655626085}}} #metrics {"StartTime": 1616444490.402989, "EndTime": 1616444490.4029996, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780452826605904, "count": 1, "min": 0.44780452826605904, "max": 0.44780452826605904}}} #metrics {"StartTime": 1616444490.4030316, "EndTime": 1616444490.4030385, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44892684895833335, "count": 1, "min": 0.44892684895833335, "max": 0.44892684895833335}}} #metrics {"StartTime": 1616444490.4030714, "EndTime": 1616444490.4030814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478045281982422, "count": 1, "min": 0.4478045281982422, "max": 0.4478045281982422}}} #metrics {"StartTime": 1616444490.4031212, "EndTime": 1616444490.403133, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44892715155707463, "count": 1, "min": 0.44892715155707463, "max": 0.44892715155707463}}} #metrics {"StartTime": 1616444490.4031744, "EndTime": 1616444490.4031851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847385531955296, "count": 1, "min": 0.6847385531955296, "max": 0.6847385531955296}}} #metrics {"StartTime": 1616444490.4032264, "EndTime": 1616444490.403237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848521278211805, "count": 1, "min": 0.6848521278211805, "max": 0.6848521278211805}}} #metrics {"StartTime": 1616444490.4032626, "EndTime": 1616444490.4032688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847382670084635, "count": 1, "min": 0.6847382670084635, "max": 0.6847382670084635}}} #metrics {"StartTime": 1616444490.4032998, "EndTime": 1616444490.4033096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848531842719184, "count": 1, "min": 0.6848531842719184, "max": 0.6848531842719184}}} #metrics {"StartTime": 1616444490.4033482, "EndTime": 1616444490.4033594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694342719184, "count": 1, "min": 0.6848694342719184, "max": 0.6848694342719184}}} #metrics {"StartTime": 1616444490.4033992, "EndTime": 1616444490.4034102, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865029635959201, "count": 1, "min": 0.6865029635959201, "max": 0.6865029635959201}}} #metrics {"StartTime": 1616444490.4034493, "EndTime": 1616444490.40346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684869262017144, "count": 1, "min": 0.684869262017144, "max": 0.684869262017144}}} #metrics {"StartTime": 1616444490.4035008, "EndTime": 1616444490.40351, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865034022352431, "count": 1, "min": 0.6865034022352431, "max": 0.6865034022352431}}} [03/22/2021 20:21:30 INFO 140710537553728] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.15674167239718967 [2021-03-22 20:21:31.473] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 20, "duration": 1053, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444492.1827776, "EndTime": 1616444492.1828418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15729633505217083, "count": 1, "min": 0.15729633505217083, "max": 0.15729633505217083}}} #metrics {"StartTime": 1616444492.1829143, "EndTime": 1616444492.1829245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1448213719721062, "count": 1, "min": 0.1448213719721062, "max": 0.1448213719721062}}} #metrics {"StartTime": 1616444492.183137, "EndTime": 1616444492.1831553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1592287340717407, "count": 1, "min": 0.1592287340717407, "max": 0.1592287340717407}}} #metrics {"StartTime": 1616444492.1831987, "EndTime": 1616444492.18321, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1452134679686374, "count": 1, "min": 0.1452134679686374, "max": 0.1452134679686374}}} #metrics {"StartTime": 1616444492.1832504, "EndTime": 1616444492.18326, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024172984731098, "count": 1, "min": 0.14024172984731098, "max": 0.14024172984731098}}} #metrics {"StartTime": 1616444492.18329, "EndTime": 1616444492.1832998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14247222725795647, "count": 1, "min": 0.14247222725795647, "max": 0.14247222725795647}}} #metrics {"StartTime": 1616444492.1833324, "EndTime": 1616444492.183342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024016410931853, "count": 1, "min": 0.14024016410931853, "max": 0.14024016410931853}}} #metrics {"StartTime": 1616444492.1833727, "EndTime": 1616444492.183382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1424705507401268, "count": 1, "min": 0.1424705507401268, "max": 0.1424705507401268}}} #metrics {"StartTime": 1616444492.1834102, "EndTime": 1616444492.1834195, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17635394535061313, "count": 1, "min": 0.17635394535061313, "max": 0.17635394535061313}}} #metrics {"StartTime": 1616444492.1834433, "EndTime": 1616444492.1834521, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414147920254933, "count": 1, "min": 0.17414147920254933, "max": 0.17414147920254933}}} #metrics {"StartTime": 1616444492.1834805, "EndTime": 1616444492.1834898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17591850493253283, "count": 1, "min": 0.17591850493253283, "max": 0.17591850493253283}}} #metrics {"StartTime": 1616444492.1835198, "EndTime": 1616444492.1835294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741464613853077, "count": 1, "min": 0.1741464613853077, "max": 0.1741464613853077}}} #metrics {"StartTime": 1616444492.1835632, "EndTime": 1616444492.1835728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433793306646775, "count": 1, "min": 0.17433793306646775, "max": 0.17433793306646775}}} #metrics {"StartTime": 1616444492.183602, "EndTime": 1616444492.183611, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1745867342269651, "count": 1, "min": 0.1745867342269651, "max": 0.1745867342269651}}} #metrics {"StartTime": 1616444492.1836329, "EndTime": 1616444492.1836417, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743291864670907, "count": 1, "min": 0.1743291864670907, "max": 0.1743291864670907}}} #metrics {"StartTime": 1616444492.1836674, "EndTime": 1616444492.1836758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1745361555504507, "count": 1, "min": 0.1745361555504507, "max": 0.1745361555504507}}} #metrics {"StartTime": 1616444492.183708, "EndTime": 1616444492.183717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44927927815408725, "count": 1, "min": 0.44927927815408725, "max": 0.44927927815408725}}} #metrics {"StartTime": 1616444492.1837523, "EndTime": 1616444492.1837618, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497008118791024, "count": 1, "min": 0.4497008118791024, "max": 0.4497008118791024}}} #metrics {"StartTime": 1616444492.1837928, "EndTime": 1616444492.183799, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493106811588403, "count": 1, "min": 0.4493106811588403, "max": 0.4493106811588403}}} #metrics {"StartTime": 1616444492.18382, "EndTime": 1616444492.1838276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44971792110424846, "count": 1, "min": 0.44971792110424846, "max": 0.44971792110424846}}} #metrics {"StartTime": 1616444492.18386, "EndTime": 1616444492.183869, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497307642567384, "count": 1, "min": 0.4497307642567384, "max": 0.4497307642567384}}} #metrics {"StartTime": 1616444492.1838942, "EndTime": 1616444492.1839025, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064060088694463, "count": 1, "min": 0.45064060088694463, "max": 0.45064060088694463}}} #metrics {"StartTime": 1616444492.1839316, "EndTime": 1616444492.1839397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497197466368622, "count": 1, "min": 0.4497197466368622, "max": 0.4497197466368622}}} #metrics {"StartTime": 1616444492.1839693, "EndTime": 1616444492.1839778, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064281919058785, "count": 1, "min": 0.45064281919058785, "max": 0.45064281919058785}}} #metrics {"StartTime": 1616444492.1840105, "EndTime": 1616444492.1840186, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847419878174824, "count": 1, "min": 0.6847419878174824, "max": 0.6847419878174824}}} #metrics {"StartTime": 1616444492.184054, "EndTime": 1616444492.1840634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849558753283793, "count": 1, "min": 0.6849558753283793, "max": 0.6849558753283793}}} #metrics {"StartTime": 1616444492.184093, "EndTime": 1616444492.1841018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847582292108433, "count": 1, "min": 0.6847582292108433, "max": 0.6847582292108433}}} #metrics {"StartTime": 1616444492.1841345, "EndTime": 1616444492.1841435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851957704531548, "count": 1, "min": 0.6851957704531548, "max": 0.6851957704531548}}} #metrics {"StartTime": 1616444492.1841803, "EndTime": 1616444492.1841896, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497457897112, "count": 1, "min": 0.6847497457897112, "max": 0.6847497457897112}}} #metrics {"StartTime": 1616444492.1842227, "EndTime": 1616444492.1842318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821593261090749, "count": 1, "min": 0.6821593261090749, "max": 0.6821593261090749}}} #metrics {"StartTime": 1616444492.184268, "EndTime": 1616444492.1843243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846212024698871, "count": 1, "min": 0.6846212024698871, "max": 0.6846212024698871}}} #metrics {"StartTime": 1616444492.184361, "EndTime": 1616444492.1843686, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821606893033577, "count": 1, "min": 0.6821606893033577, "max": 0.6821606893033577}}} [03/22/2021 20:21:32 INFO 140710537553728] #quality_metric: host=algo-1, epoch=6, validation binary_classification_cross_entropy_objective <loss>=0.15729633505217083 [03/22/2021 20:21:32 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:21:32 INFO 140710537553728] Epoch 6: Loss improved. Updating best model [03/22/2021 20:21:32 INFO 140710537553728] Saving model for epoch: 6 [03/22/2021 20:21:32 INFO 140710537553728] Saved checkpoint to "/tmp/tmp4ar71sxg/mx-mod-0000.params" [03/22/2021 20:21:32 INFO 140710537553728] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs #metrics {"StartTime": 1616444480.2574468, "EndTime": 1616444492.1899028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3168727.0, "count": 1, "min": 3168727, "max": 3168727}, "Total Batches Seen": {"sum": 3169.0, "count": 1, "min": 3169, "max": 3169}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:21:32 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=37792.496791708596 records/second [2021-03-22 20:21:43.398] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 17, "duration": 11208, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444503.3988817, "EndTime": 1616444503.3989844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15587011425442165, "count": 1, "min": 0.15587011425442165, "max": 0.15587011425442165}}} #metrics {"StartTime": 1616444503.3990757, "EndTime": 1616444503.3990898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14294777491251628, "count": 1, "min": 0.14294777491251628, "max": 0.14294777491251628}}} #metrics {"StartTime": 1616444503.3991404, "EndTime": 1616444503.3991506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1578279874165853, "count": 1, "min": 0.1578279874165853, "max": 0.1578279874165853}}} #metrics {"StartTime": 1616444503.3991814, "EndTime": 1616444503.3991895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14333093114217121, "count": 1, "min": 0.14333093114217121, "max": 0.14333093114217121}}} #metrics {"StartTime": 1616444503.3992357, "EndTime": 1616444503.3992445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13859164939032662, "count": 1, "min": 0.13859164939032662, "max": 0.13859164939032662}}} #metrics {"StartTime": 1616444503.3992872, "EndTime": 1616444503.3992963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14146294052124023, "count": 1, "min": 0.14146294052124023, "max": 0.14146294052124023}}} #metrics {"StartTime": 1616444503.399327, "EndTime": 1616444503.3993342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13859015625, "count": 1, "min": 0.13859015625, "max": 0.13859015625}}} #metrics {"StartTime": 1616444503.3993764, "EndTime": 1616444503.399385, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14146282343546548, "count": 1, "min": 0.14146282343546548, "max": 0.14146282343546548}}} #metrics {"StartTime": 1616444503.3994124, "EndTime": 1616444503.3994193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17522680399576823, "count": 1, "min": 0.17522680399576823, "max": 0.17522680399576823}}} #metrics {"StartTime": 1616444503.399446, "EndTime": 1616444503.3994532, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338137986924912, "count": 1, "min": 0.17338137986924912, "max": 0.17338137986924912}}} #metrics {"StartTime": 1616444503.39948, "EndTime": 1616444503.3994873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17480793199327258, "count": 1, "min": 0.17480793199327258, "max": 0.17480793199327258}}} #metrics {"StartTime": 1616444503.3995144, "EndTime": 1616444503.3995214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338226013183594, "count": 1, "min": 0.17338226013183594, "max": 0.17338226013183594}}} #metrics {"StartTime": 1616444503.3995497, "EndTime": 1616444503.3995569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338776028103298, "count": 1, "min": 0.17338776028103298, "max": 0.17338776028103298}}} #metrics {"StartTime": 1616444503.3995838, "EndTime": 1616444503.399591, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17528300265842015, "count": 1, "min": 0.17528300265842015, "max": 0.17528300265842015}}} #metrics {"StartTime": 1616444503.3996172, "EndTime": 1616444503.3996243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338756958007812, "count": 1, "min": 0.17338756958007812, "max": 0.17338756958007812}}} #metrics {"StartTime": 1616444503.399651, "EndTime": 1616444503.399658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1752851213921441, "count": 1, "min": 0.1752851213921441, "max": 0.1752851213921441}}} #metrics {"StartTime": 1616444503.3996842, "EndTime": 1616444503.3996909, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768269504123265, "count": 1, "min": 0.44768269504123265, "max": 0.44768269504123265}}} #metrics {"StartTime": 1616444503.399717, "EndTime": 1616444503.399724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477903561062283, "count": 1, "min": 0.4477903561062283, "max": 0.4477903561062283}}} #metrics {"StartTime": 1616444503.39975, "EndTime": 1616444503.3997571, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768262132432723, "count": 1, "min": 0.44768262132432723, "max": 0.44768262132432723}}} #metrics {"StartTime": 1616444503.3997834, "EndTime": 1616444503.3997903, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477903380669488, "count": 1, "min": 0.4477903380669488, "max": 0.4477903380669488}}} #metrics {"StartTime": 1616444503.3998168, "EndTime": 1616444503.399824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477557081434462, "count": 1, "min": 0.4477557081434462, "max": 0.4477557081434462}}} #metrics {"StartTime": 1616444503.399934, "EndTime": 1616444503.399942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44890473870171443, "count": 1, "min": 0.44890473870171443, "max": 0.44890473870171443}}} #metrics {"StartTime": 1616444503.3999705, "EndTime": 1616444503.3999777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477557563612196, "count": 1, "min": 0.4477557563612196, "max": 0.4477557563612196}}} #metrics {"StartTime": 1616444503.4000041, "EndTime": 1616444503.400011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44890479634602865, "count": 1, "min": 0.44890479634602865, "max": 0.44890479634602865}}} #metrics {"StartTime": 1616444503.4000373, "EndTime": 1616444503.4000444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847345888943143, "count": 1, "min": 0.6847345888943143, "max": 0.6847345888943143}}} #metrics {"StartTime": 1616444503.4000754, "EndTime": 1616444503.4000828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684848889702691, "count": 1, "min": 0.684848889702691, "max": 0.684848889702691}}} #metrics {"StartTime": 1616444503.4001122, "EndTime": 1616444503.400119, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847346809895833, "count": 1, "min": 0.6847346809895833, "max": 0.6847346809895833}}} #metrics {"StartTime": 1616444503.400149, "EndTime": 1616444503.4001563, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848486617024739, "count": 1, "min": 0.6848486617024739, "max": 0.6848486617024739}}} #metrics {"StartTime": 1616444503.4001858, "EndTime": 1616444503.400193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684824090983073, "count": 1, "min": 0.684824090983073, "max": 0.684824090983073}}} #metrics {"StartTime": 1616444503.4002213, "EndTime": 1616444503.4002285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864386593967013, "count": 1, "min": 0.6864386593967013, "max": 0.6864386593967013}}} #metrics {"StartTime": 1616444503.4002552, "EndTime": 1616444503.4002626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848247837999132, "count": 1, "min": 0.6848247837999132, "max": 0.6848247837999132}}} #metrics {"StartTime": 1616444503.4003084, "EndTime": 1616444503.4003165, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864388244628906, "count": 1, "min": 0.6864388244628906, "max": 0.6864388244628906}}} [03/22/2021 20:21:43 INFO 140710537553728] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.15587011425442165 [2021-03-22 20:21:44.506] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 23, "duration": 1089, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444505.152312, "EndTime": 1616444505.152377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15660224448964172, "count": 1, "min": 0.15660224448964172, "max": 0.15660224448964172}}} #metrics {"StartTime": 1616444505.152447, "EndTime": 1616444505.1524572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1438427918173435, "count": 1, "min": 0.1438427918173435, "max": 0.1438427918173435}}} #metrics {"StartTime": 1616444505.152489, "EndTime": 1616444505.1524968, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1584550556063081, "count": 1, "min": 0.1584550556063081, "max": 0.1584550556063081}}} #metrics {"StartTime": 1616444505.152527, "EndTime": 1616444505.1525362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1441764838310216, "count": 1, "min": 0.1441764838310216, "max": 0.1441764838310216}}} #metrics {"StartTime": 1616444505.1525726, "EndTime": 1616444505.1525824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402462124042061, "count": 1, "min": 0.1402462124042061, "max": 0.1402462124042061}}} #metrics {"StartTime": 1616444505.1526144, "EndTime": 1616444505.1526227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.142366888287517, "count": 1, "min": 0.142366888287517, "max": 0.142366888287517}}} #metrics {"StartTime": 1616444505.1526544, "EndTime": 1616444505.1526632, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024448526736713, "count": 1, "min": 0.14024448526736713, "max": 0.14024448526736713}}} #metrics {"StartTime": 1616444505.1527004, "EndTime": 1616444505.15271, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14236597572422754, "count": 1, "min": 0.14236597572422754, "max": 0.14236597572422754}}} #metrics {"StartTime": 1616444505.1527421, "EndTime": 1616444505.1527512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17604264250371776, "count": 1, "min": 0.17604264250371776, "max": 0.17604264250371776}}} #metrics {"StartTime": 1616444505.1527824, "EndTime": 1616444505.1527905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414621729069998, "count": 1, "min": 0.17414621729069998, "max": 0.17414621729069998}}} #metrics {"StartTime": 1616444505.1528175, "EndTime": 1616444505.152825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17565157140678012, "count": 1, "min": 0.17565157140678012, "max": 0.17565157140678012}}} #metrics {"StartTime": 1616444505.1528537, "EndTime": 1616444505.1528623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741523163399418, "count": 1, "min": 0.1741523163399418, "max": 0.1741523163399418}}} #metrics {"StartTime": 1616444505.1528938, "EndTime": 1616444505.1529026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420705633212516, "count": 1, "min": 0.17420705633212516, "max": 0.17420705633212516}}} #metrics {"StartTime": 1616444505.1529343, "EndTime": 1616444505.152944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17463607206102674, "count": 1, "min": 0.17463607206102674, "max": 0.17463607206102674}}} #metrics {"StartTime": 1616444505.1529818, "EndTime": 1616444505.1529908, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420281814052763, "count": 1, "min": 0.17420281814052763, "max": 0.17420281814052763}}} #metrics {"StartTime": 1616444505.1530247, "EndTime": 1616444505.1530337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17459016914631598, "count": 1, "min": 0.17459016914631598, "max": 0.17459016914631598}}} #metrics {"StartTime": 1616444505.1530712, "EndTime": 1616444505.1530797, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4491106681289118, "count": 1, "min": 0.4491106681289118, "max": 0.4491106681289118}}} #metrics {"StartTime": 1616444505.1531157, "EndTime": 1616444505.1531246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970984642484924, "count": 1, "min": 0.44970984642484924, "max": 0.44970984642484924}}} #metrics {"StartTime": 1616444505.1531603, "EndTime": 1616444505.1531696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912776300749374, "count": 1, "min": 0.44912776300749374, "max": 0.44912776300749374}}} #metrics {"StartTime": 1616444505.153205, "EndTime": 1616444505.1532137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497276312919591, "count": 1, "min": 0.4497276312919591, "max": 0.4497276312919591}}} #metrics {"StartTime": 1616444505.1532495, "EndTime": 1616444505.153259, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45058305465267845, "count": 1, "min": 0.45058305465267845, "max": 0.45058305465267845}}} #metrics {"StartTime": 1616444505.1532881, "EndTime": 1616444505.1532984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45015655593371295, "count": 1, "min": 0.45015655593371295, "max": 0.45015655593371295}}} #metrics {"StartTime": 1616444505.153331, "EndTime": 1616444505.1533403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4505792514597331, "count": 1, "min": 0.4505792514597331, "max": 0.4505792514597331}}} #metrics {"StartTime": 1616444505.1533747, "EndTime": 1616444505.1533837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45015733822749315, "count": 1, "min": 0.45015733822749315, "max": 0.45015733822749315}}} #metrics {"StartTime": 1616444505.1534188, "EndTime": 1616444505.1534293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847964194938818, "count": 1, "min": 0.6847964194938818, "max": 0.6847964194938818}}} #metrics {"StartTime": 1616444505.1534636, "EndTime": 1616444505.1534731, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849860845907203, "count": 1, "min": 0.6849860845907203, "max": 0.6849860845907203}}} #metrics {"StartTime": 1616444505.1535103, "EndTime": 1616444505.15352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847697237863045, "count": 1, "min": 0.6847697237863045, "max": 0.6847697237863045}}} #metrics {"StartTime": 1616444505.1535556, "EndTime": 1616444505.1535647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853051505529523, "count": 1, "min": 0.6853051505529523, "max": 0.6853051505529523}}} #metrics {"StartTime": 1616444505.1535966, "EndTime": 1616444505.153607, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845692099800806, "count": 1, "min": 0.6845692099800806, "max": 0.6845692099800806}}} #metrics {"StartTime": 1616444505.1536415, "EndTime": 1616444505.1536512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682262300332641, "count": 1, "min": 0.682262300332641, "max": 0.682262300332641}}} #metrics {"StartTime": 1616444505.1536832, "EndTime": 1616444505.1536922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844077967869933, "count": 1, "min": 0.6844077967869933, "max": 0.6844077967869933}}} #metrics {"StartTime": 1616444505.1537268, "EndTime": 1616444505.153736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682262464370714, "count": 1, "min": 0.682262464370714, "max": 0.682262464370714}}} [03/22/2021 20:21:45 INFO 140710537553728] #quality_metric: host=algo-1, epoch=7, validation binary_classification_cross_entropy_objective <loss>=0.15660224448964172 [03/22/2021 20:21:45 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:21:45 INFO 140710537553728] Epoch 7: Loss improved. Updating best model [03/22/2021 20:21:45 INFO 140710537553728] Saving model for epoch: 7 [03/22/2021 20:21:45 INFO 140710537553728] Saved checkpoint to "/tmp/tmpk9nsrk1s/mx-mod-0000.params" [03/22/2021 20:21:45 INFO 140710537553728] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs #metrics {"StartTime": 1616444492.1900887, "EndTime": 1616444505.1589253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3619688.0, "count": 1, "min": 3619688, "max": 3619688}, "Total Batches Seen": {"sum": 3620.0, "count": 1, "min": 3620, "max": 3620}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:21:45 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=34772.38114331346 records/second [2021-03-22 20:21:55.003] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 19, "duration": 9841, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444515.0032005, "EndTime": 1616444515.0033884, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15528282743665908, "count": 1, "min": 0.15528282743665908, "max": 0.15528282743665908}}} #metrics {"StartTime": 1616444515.0034702, "EndTime": 1616444515.003484, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14202935830010308, "count": 1, "min": 0.14202935830010308, "max": 0.14202935830010308}}} #metrics {"StartTime": 1616444515.0035164, "EndTime": 1616444515.0035238, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15717111423068578, "count": 1, "min": 0.15717111423068578, "max": 0.15717111423068578}}} #metrics {"StartTime": 1616444515.003546, "EndTime": 1616444515.0035534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1423593005540636, "count": 1, "min": 0.1423593005540636, "max": 0.1423593005540636}}} #metrics {"StartTime": 1616444515.0035865, "EndTime": 1616444515.0035954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13852168918185764, "count": 1, "min": 0.13852168918185764, "max": 0.13852168918185764}}} #metrics {"StartTime": 1616444515.003632, "EndTime": 1616444515.0036423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.141345799407959, "count": 1, "min": 0.141345799407959, "max": 0.141345799407959}}} #metrics {"StartTime": 1616444515.0036752, "EndTime": 1616444515.0036843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13852029991997614, "count": 1, "min": 0.13852029991997614, "max": 0.13852029991997614}}} #metrics {"StartTime": 1616444515.00372, "EndTime": 1616444515.0037293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14134586052788628, "count": 1, "min": 0.14134586052788628, "max": 0.14134586052788628}}} #metrics {"StartTime": 1616444515.0037687, "EndTime": 1616444515.0037782, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496830674913194, "count": 1, "min": 0.17496830674913194, "max": 0.17496830674913194}}} #metrics {"StartTime": 1616444515.0038168, "EndTime": 1616444515.0038261, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337708767361112, "count": 1, "min": 0.17337708767361112, "max": 0.17337708767361112}}} #metrics {"StartTime": 1616444515.003866, "EndTime": 1616444515.0038748, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1745865229288737, "count": 1, "min": 0.1745865229288737, "max": 0.1745865229288737}}} #metrics {"StartTime": 1616444515.0039139, "EndTime": 1616444515.0039237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733777173868815, "count": 1, "min": 0.1733777173868815, "max": 0.1733777173868815}}} #metrics {"StartTime": 1616444515.0039618, "EndTime": 1616444515.003971, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17332972432454427, "count": 1, "min": 0.17332972432454427, "max": 0.17332972432454427}}} #metrics {"StartTime": 1616444515.0040076, "EndTime": 1616444515.0040162, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17524100429958767, "count": 1, "min": 0.17524100429958767, "max": 0.17524100429958767}}} #metrics {"StartTime": 1616444515.0040529, "EndTime": 1616444515.0040612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17332956827799478, "count": 1, "min": 0.17332956827799478, "max": 0.17332956827799478}}} #metrics {"StartTime": 1616444515.0040941, "EndTime": 1616444515.004103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17524265072292752, "count": 1, "min": 0.17524265072292752, "max": 0.17524265072292752}}} #metrics {"StartTime": 1616444515.0041387, "EndTime": 1616444515.0041473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768100206163197, "count": 1, "min": 0.44768100206163197, "max": 0.44768100206163197}}} #metrics {"StartTime": 1616444515.004182, "EndTime": 1616444515.00419, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44778426520453557, "count": 1, "min": 0.44778426520453557, "max": 0.44778426520453557}}} #metrics {"StartTime": 1616444515.0042243, "EndTime": 1616444515.004233, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476815028211806, "count": 1, "min": 0.4476815028211806, "max": 0.4476815028211806}}} #metrics {"StartTime": 1616444515.00427, "EndTime": 1616444515.0042977, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477842779541016, "count": 1, "min": 0.4477842779541016, "max": 0.4477842779541016}}} #metrics {"StartTime": 1616444515.0043385, "EndTime": 1616444515.0043485, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477248414442274, "count": 1, "min": 0.4477248414442274, "max": 0.4477248414442274}}} #metrics {"StartTime": 1616444515.0043871, "EndTime": 1616444515.0043972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4488536950005425, "count": 1, "min": 0.4488536950005425, "max": 0.4488536950005425}}} #metrics {"StartTime": 1616444515.004436, "EndTime": 1616444515.0044458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477247457546658, "count": 1, "min": 0.4477247457546658, "max": 0.4477247457546658}}} #metrics {"StartTime": 1616444515.004484, "EndTime": 1616444515.0044935, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44885365966796875, "count": 1, "min": 0.44885365966796875, "max": 0.44885365966796875}}} #metrics {"StartTime": 1616444515.0045302, "EndTime": 1616444515.0045388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320963541667, "count": 1, "min": 0.6847320963541667, "max": 0.6847320963541667}}} #metrics {"StartTime": 1616444515.0045753, "EndTime": 1616444515.0045836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848452604166667, "count": 1, "min": 0.6848452604166667, "max": 0.6848452604166667}}} #metrics {"StartTime": 1616444515.0046167, "EndTime": 1616444515.004625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847326051161025, "count": 1, "min": 0.6847326051161025, "max": 0.6847326051161025}}} #metrics {"StartTime": 1616444515.0046613, "EndTime": 1616444515.0046697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848448480902778, "count": 1, "min": 0.6848448480902778, "max": 0.6848448480902778}}} #metrics {"StartTime": 1616444515.0047045, "EndTime": 1616444515.0047128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847987456597222, "count": 1, "min": 0.6847987456597222, "max": 0.6847987456597222}}} #metrics {"StartTime": 1616444515.0047479, "EndTime": 1616444515.004757, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863899919976129, "count": 1, "min": 0.6863899919976129, "max": 0.6863899919976129}}} #metrics {"StartTime": 1616444515.004795, "EndTime": 1616444515.0048048, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847984905327691, "count": 1, "min": 0.6847984905327691, "max": 0.6847984905327691}}} #metrics {"StartTime": 1616444515.0048435, "EndTime": 1616444515.0048528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863900553385417, "count": 1, "min": 0.6863900553385417, "max": 0.6863900553385417}}} [03/22/2021 20:21:55 INFO 140710537553728] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.15528282743665908 [2021-03-22 20:21:56.045] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 26, "duration": 1025, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444516.7657108, "EndTime": 1616444516.7657773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15613336209521683, "count": 1, "min": 0.15613336209521683, "max": 0.15613336209521683}}} #metrics {"StartTime": 1616444516.7658489, "EndTime": 1616444516.765859, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1430858956513431, "count": 1, "min": 0.1430858956513431, "max": 0.1430858956513431}}} #metrics {"StartTime": 1616444516.7658854, "EndTime": 1616444516.7658932, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1579179780373701, "count": 1, "min": 0.1579179780373701, "max": 0.1579179780373701}}} #metrics {"StartTime": 1616444516.7659278, "EndTime": 1616444516.7659361, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1433685383941342, "count": 1, "min": 0.1433685383941342, "max": 0.1433685383941342}}} #metrics {"StartTime": 1616444516.7659678, "EndTime": 1616444516.7659752, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026178519354024, "count": 1, "min": 0.14026178519354024, "max": 0.14026178519354024}}} #metrics {"StartTime": 1616444516.766007, "EndTime": 1616444516.766015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220744605518643, "count": 1, "min": 0.14220744605518643, "max": 0.14220744605518643}}} #metrics {"StartTime": 1616444516.7660503, "EndTime": 1616444516.766059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026065722877132, "count": 1, "min": 0.14026065722877132, "max": 0.14026065722877132}}} #metrics {"StartTime": 1616444516.7660956, "EndTime": 1616444516.7661045, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220673380241508, "count": 1, "min": 0.14220673380241508, "max": 0.14220673380241508}}} #metrics {"StartTime": 1616444516.7661395, "EndTime": 1616444516.7661488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17583435258904268, "count": 1, "min": 0.17583435258904268, "max": 0.17583435258904268}}} #metrics {"StartTime": 1616444516.7661831, "EndTime": 1616444516.7661922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741533048994177, "count": 1, "min": 0.1741533048994177, "max": 0.1741533048994177}}} #metrics {"StartTime": 1616444516.766213, "EndTime": 1616444516.7662182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17547174913569802, "count": 1, "min": 0.17547174913569802, "max": 0.17547174913569802}}} #metrics {"StartTime": 1616444516.7662382, "EndTime": 1616444516.7662458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741601115320303, "count": 1, "min": 0.1741601115320303, "max": 0.1741601115320303}}} #metrics {"StartTime": 1616444516.766283, "EndTime": 1616444516.7662926, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17425599110894155, "count": 1, "min": 0.17425599110894155, "max": 0.17425599110894155}}} #metrics {"StartTime": 1616444516.7663298, "EndTime": 1616444516.7663395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17495283688850938, "count": 1, "min": 0.17495283688850938, "max": 0.17495283688850938}}} #metrics {"StartTime": 1616444516.7663746, "EndTime": 1616444516.7663844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17425392425629144, "count": 1, "min": 0.17425392425629144, "max": 0.17425392425629144}}} #metrics {"StartTime": 1616444516.7664201, "EndTime": 1616444516.766427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17491747856309317, "count": 1, "min": 0.17491747856309317, "max": 0.17491747856309317}}} #metrics {"StartTime": 1616444516.7664504, "EndTime": 1616444516.766456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44897307077366894, "count": 1, "min": 0.44897307077366894, "max": 0.44897307077366894}}} #metrics {"StartTime": 1616444516.766479, "EndTime": 1616444516.7664862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497754253815818, "count": 1, "min": 0.4497754253815818, "max": 0.4497754253815818}}} #metrics {"StartTime": 1616444516.7665186, "EndTime": 1616444516.7665274, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490292226843151, "count": 1, "min": 0.4490292226843151, "max": 0.4490292226843151}}} #metrics {"StartTime": 1616444516.7665558, "EndTime": 1616444516.7665646, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44979063652922374, "count": 1, "min": 0.44979063652922374, "max": 0.44979063652922374}}} #metrics {"StartTime": 1616444516.766594, "EndTime": 1616444516.7666028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501909351737994, "count": 1, "min": 0.4501909351737994, "max": 0.4501909351737994}}} #metrics {"StartTime": 1616444516.766632, "EndTime": 1616444516.766641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44995561227194486, "count": 1, "min": 0.44995561227194486, "max": 0.44995561227194486}}} #metrics {"StartTime": 1616444516.766672, "EndTime": 1616444516.7666802, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501931594326201, "count": 1, "min": 0.4501931594326201, "max": 0.4501931594326201}}} #metrics {"StartTime": 1616444516.7667153, "EndTime": 1616444516.7667239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44995697221794895, "count": 1, "min": 0.44995697221794895, "max": 0.44995697221794895}}} #metrics {"StartTime": 1616444516.766753, "EndTime": 1616444516.766762, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847951012341207, "count": 1, "min": 0.6847951012341207, "max": 0.6847951012341207}}} #metrics {"StartTime": 1616444516.7667983, "EndTime": 1616444516.7668076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850502911497139, "count": 1, "min": 0.6850502911497139, "max": 0.6850502911497139}}} #metrics {"StartTime": 1616444516.76684, "EndTime": 1616444516.766849, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847619693330443, "count": 1, "min": 0.6847619693330443, "max": 0.6847619693330443}}} #metrics {"StartTime": 1616444516.7668862, "EndTime": 1616444516.7668946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852790777028104, "count": 1, "min": 0.6852790777028104, "max": 0.6852790777028104}}} #metrics {"StartTime": 1616444516.7669222, "EndTime": 1616444516.766931, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842289406081262, "count": 1, "min": 0.6842289406081262, "max": 0.6842289406081262}}} #metrics {"StartTime": 1616444516.7669575, "EndTime": 1616444516.7669666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835660605898389, "count": 1, "min": 0.6835660605898389, "max": 0.6835660605898389}}} #metrics {"StartTime": 1616444516.766994, "EndTime": 1616444516.7670026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842748693737215, "count": 1, "min": 0.6842748693737215, "max": 0.6842748693737215}}} #metrics {"StartTime": 1616444516.767025, "EndTime": 1616444516.7670333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835661336761091, "count": 1, "min": 0.6835661336761091, "max": 0.6835661336761091}}} [03/22/2021 20:21:56 INFO 140710537553728] #quality_metric: host=algo-1, epoch=8, validation binary_classification_cross_entropy_objective <loss>=0.15613336209521683 [03/22/2021 20:21:56 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:21:56 INFO 140710537553728] Epoch 8: Loss improved. Updating best model [03/22/2021 20:21:56 INFO 140710537553728] Saving model for epoch: 8 [03/22/2021 20:21:56 INFO 140710537553728] Saved checkpoint to "/tmp/tmp7u_jl5i0/mx-mod-0000.params" [03/22/2021 20:21:56 INFO 140710537553728] #progress_metric: host=algo-1, completed 60.0 % of epochs #metrics {"StartTime": 1616444505.1619632, "EndTime": 1616444516.7722085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4070649.0, "count": 1, "min": 4070649, "max": 4070649}, "Total Batches Seen": {"sum": 4071.0, "count": 1, "min": 4071, "max": 4071}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:21:56 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=38841.19232544003 records/second [2021-03-22 20:22:08.300] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 21, "duration": 11525, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444528.3003445, "EndTime": 1616444528.3004332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15488599865383573, "count": 1, "min": 0.15488599865383573, "max": 0.15488599865383573}}} #metrics {"StartTime": 1616444528.300518, "EndTime": 1616444528.3005345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14132234926011827, "count": 1, "min": 0.14132234926011827, "max": 0.14132234926011827}}} #metrics {"StartTime": 1616444528.3005736, "EndTime": 1616444528.300584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15664957005818686, "count": 1, "min": 0.15664957005818686, "max": 0.15664957005818686}}} #metrics {"StartTime": 1616444528.30062, "EndTime": 1616444528.3006291, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159552612304688, "count": 1, "min": 0.14159552612304688, "max": 0.14159552612304688}}} #metrics {"StartTime": 1616444528.300669, "EndTime": 1616444528.3006797, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13847898764716254, "count": 1, "min": 0.13847898764716254, "max": 0.13847898764716254}}} #metrics {"StartTime": 1616444528.300717, "EndTime": 1616444528.3007276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14122574011908637, "count": 1, "min": 0.14122574011908637, "max": 0.14122574011908637}}} #metrics {"StartTime": 1616444528.3007658, "EndTime": 1616444528.3007758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13847764526367187, "count": 1, "min": 0.13847764526367187, "max": 0.13847764526367187}}} #metrics {"StartTime": 1616444528.3008118, "EndTime": 1616444528.3008218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14122567918565537, "count": 1, "min": 0.14122567918565537, "max": 0.14122567918565537}}} #metrics {"StartTime": 1616444528.3008587, "EndTime": 1616444528.3008687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17479460269504124, "count": 1, "min": 0.17479460269504124, "max": 0.17479460269504124}}} #metrics {"StartTime": 1616444528.30091, "EndTime": 1616444528.3009212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337308213975694, "count": 1, "min": 0.17337308213975694, "max": 0.17337308213975694}}} #metrics {"StartTime": 1616444528.30096, "EndTime": 1616444528.3009713, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17441857594807944, "count": 1, "min": 0.17441857594807944, "max": 0.17441857594807944}}} #metrics {"StartTime": 1616444528.3010094, "EndTime": 1616444528.3010192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337383561876085, "count": 1, "min": 0.17337383561876085, "max": 0.17337383561876085}}} #metrics {"StartTime": 1616444528.301058, "EndTime": 1616444528.3010693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732899772813585, "count": 1, "min": 0.1732899772813585, "max": 0.1732899772813585}}} #metrics {"StartTime": 1616444528.3011096, "EndTime": 1616444528.3011203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520598870171442, "count": 1, "min": 0.17520598870171442, "max": 0.17520598870171442}}} #metrics {"StartTime": 1616444528.3011582, "EndTime": 1616444528.3011687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17328982883029515, "count": 1, "min": 0.17328982883029515, "max": 0.17328982883029515}}} #metrics {"StartTime": 1616444528.3012059, "EndTime": 1616444528.3012156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520685333251954, "count": 1, "min": 0.17520685333251954, "max": 0.17520685333251954}}} #metrics {"StartTime": 1616444528.301254, "EndTime": 1616444528.301264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476799619547526, "count": 1, "min": 0.4476799619547526, "max": 0.4476799619547526}}} #metrics {"StartTime": 1616444528.3012972, "EndTime": 1616444528.3013086, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44778003119574655, "count": 1, "min": 0.44778003119574655, "max": 0.44778003119574655}}} #metrics {"StartTime": 1616444528.3013468, "EndTime": 1616444528.301356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767950100368925, "count": 1, "min": 0.44767950100368925, "max": 0.44767950100368925}}} #metrics {"StartTime": 1616444528.301391, "EndTime": 1616444528.301401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44778002936469186, "count": 1, "min": 0.44778002936469186, "max": 0.44778002936469186}}} #metrics {"StartTime": 1616444528.30144, "EndTime": 1616444528.3014505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44772087409125433, "count": 1, "min": 0.44772087409125433, "max": 0.44772087409125433}}} #metrics {"StartTime": 1616444528.3014874, "EndTime": 1616444528.301498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44879194532606337, "count": 1, "min": 0.44879194532606337, "max": 0.44879194532606337}}} #metrics {"StartTime": 1616444528.3015366, "EndTime": 1616444528.3015463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477208299424913, "count": 1, "min": 0.4477208299424913, "max": 0.4477208299424913}}} #metrics {"StartTime": 1616444528.3015845, "EndTime": 1616444528.3015957, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487919141981337, "count": 1, "min": 0.4487919141981337, "max": 0.4487919141981337}}} #metrics {"StartTime": 1616444528.3016343, "EndTime": 1616444528.3016448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684730565999349, "count": 1, "min": 0.684730565999349, "max": 0.684730565999349}}} #metrics {"StartTime": 1616444528.301683, "EndTime": 1616444528.301693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848417458767361, "count": 1, "min": 0.6848417458767361, "max": 0.6848417458767361}}} #metrics {"StartTime": 1616444528.3017318, "EndTime": 1616444528.3017435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320239257813, "count": 1, "min": 0.6847320239257813, "max": 0.6847320239257813}}} #metrics {"StartTime": 1616444528.3017824, "EndTime": 1616444528.301793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848415664333768, "count": 1, "min": 0.6848415664333768, "max": 0.6848415664333768}}} #metrics {"StartTime": 1616444528.3018308, "EndTime": 1616444528.3018403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847772041829427, "count": 1, "min": 0.6847772041829427, "max": 0.6847772041829427}}} #metrics {"StartTime": 1616444528.301878, "EndTime": 1616444528.3018894, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863679423014323, "count": 1, "min": 0.6863679423014323, "max": 0.6863679423014323}}} #metrics {"StartTime": 1616444528.3019288, "EndTime": 1616444528.301939, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847766577148438, "count": 1, "min": 0.6847766577148438, "max": 0.6847766577148438}}} #metrics {"StartTime": 1616444528.3019767, "EndTime": 1616444528.301987, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686367989095052, "count": 1, "min": 0.686367989095052, "max": 0.686367989095052}}} [03/22/2021 20:22:08 INFO 140710537553728] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.15488599865383573 [2021-03-22 20:22:09.367] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 29, "duration": 1049, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444530.0324948, "EndTime": 1616444530.0325637, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15581602969870872, "count": 1, "min": 0.15581602969870872, "max": 0.15581602969870872}}} #metrics {"StartTime": 1616444530.0326374, "EndTime": 1616444530.0326476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1424903647663197, "count": 1, "min": 0.1424903647663197, "max": 0.1424903647663197}}} #metrics {"StartTime": 1616444530.0326798, "EndTime": 1616444530.0326874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15740540866334113, "count": 1, "min": 0.15740540866334113, "max": 0.15740540866334113}}} #metrics {"StartTime": 1616444530.032717, "EndTime": 1616444530.032725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14272688668903907, "count": 1, "min": 0.14272688668903907, "max": 0.14272688668903907}}} #metrics {"StartTime": 1616444530.0327604, "EndTime": 1616444530.0327697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402110455918866, "count": 1, "min": 0.1402110455918866, "max": 0.1402110455918866}}} #metrics {"StartTime": 1616444530.0328026, "EndTime": 1616444530.0328112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14205501205176352, "count": 1, "min": 0.14205501205176352, "max": 0.14205501205176352}}} #metrics {"StartTime": 1616444530.032841, "EndTime": 1616444530.0328488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402101233514336, "count": 1, "min": 0.1402101233514336, "max": 0.1402101233514336}}} #metrics {"StartTime": 1616444530.0328767, "EndTime": 1616444530.0328846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14205436124559706, "count": 1, "min": 0.14205436124559706, "max": 0.14205436124559706}}} #metrics {"StartTime": 1616444530.0329137, "EndTime": 1616444530.032922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17569219424450927, "count": 1, "min": 0.17569219424450927, "max": 0.17569219424450927}}} #metrics {"StartTime": 1616444530.0329502, "EndTime": 1616444530.032958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741663353693111, "count": 1, "min": 0.1741663353693111, "max": 0.1741663353693111}}} #metrics {"StartTime": 1616444530.0329869, "EndTime": 1616444530.032996, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17530722612181687, "count": 1, "min": 0.17530722612181687, "max": 0.17530722612181687}}} #metrics {"StartTime": 1616444530.0330281, "EndTime": 1616444530.0330367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17417363039415654, "count": 1, "min": 0.17417363039415654, "max": 0.17417363039415654}}} #metrics {"StartTime": 1616444530.033062, "EndTime": 1616444530.03307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17435472368961408, "count": 1, "min": 0.17435472368961408, "max": 0.17435472368961408}}} #metrics {"StartTime": 1616444530.0330942, "EndTime": 1616444530.0331028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17534887081387832, "count": 1, "min": 0.17534887081387832, "max": 0.17534887081387832}}} #metrics {"StartTime": 1616444530.0331323, "EndTime": 1616444530.0331416, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17435338614319834, "count": 1, "min": 0.17435338614319834, "max": 0.17435338614319834}}} #metrics {"StartTime": 1616444530.033167, "EndTime": 1616444530.0331755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17532478293269496, "count": 1, "min": 0.17532478293269496, "max": 0.17532478293269496}}} #metrics {"StartTime": 1616444530.033206, "EndTime": 1616444530.0332158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4488790363543884, "count": 1, "min": 0.4488790363543884, "max": 0.4488790363543884}}} #metrics {"StartTime": 1616444530.03324, "EndTime": 1616444530.03325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498253676661663, "count": 1, "min": 0.4498253676661663, "max": 0.4498253676661663}}} #metrics {"StartTime": 1616444530.0332804, "EndTime": 1616444530.0332894, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44904411495926744, "count": 1, "min": 0.44904411495926744, "max": 0.44904411495926744}}} #metrics {"StartTime": 1616444530.0333188, "EndTime": 1616444530.0333278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44983761746641887, "count": 1, "min": 0.44983761746641887, "max": 0.44983761746641887}}} #metrics {"StartTime": 1616444530.033361, "EndTime": 1616444530.03337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494009935921423, "count": 1, "min": 0.4494009935921423, "max": 0.4494009935921423}}} #metrics {"StartTime": 1616444530.0333974, "EndTime": 1616444530.033407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501760280109031, "count": 1, "min": 0.4501760280109031, "max": 0.4501760280109031}}} #metrics {"StartTime": 1616444530.0334396, "EndTime": 1616444530.033448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44940245396409534, "count": 1, "min": 0.44940245396409534, "max": 0.44940245396409534}}} #metrics {"StartTime": 1616444530.0334766, "EndTime": 1616444530.0334847, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501769288668549, "count": 1, "min": 0.4501769288668549, "max": 0.4501769288668549}}} #metrics {"StartTime": 1616444530.0335193, "EndTime": 1616444530.0335274, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847849073235778, "count": 1, "min": 0.6847849073235778, "max": 0.6847849073235778}}} #metrics {"StartTime": 1616444530.03356, "EndTime": 1616444530.033569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852066026504569, "count": 1, "min": 0.6852066026504569, "max": 0.6852066026504569}}} #metrics {"StartTime": 1616444530.033606, "EndTime": 1616444530.0336158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847711235237223, "count": 1, "min": 0.6847711235237223, "max": 0.6847711235237223}}} #metrics {"StartTime": 1616444530.03365, "EndTime": 1616444530.033659, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853439710020532, "count": 1, "min": 0.6853439710020532, "max": 0.6853439710020532}}} #metrics {"StartTime": 1616444530.0336936, "EndTime": 1616444530.033702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843205972874188, "count": 1, "min": 0.6843205972874188, "max": 0.6843205972874188}}} #metrics {"StartTime": 1616444530.033732, "EndTime": 1616444530.0337377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402224646448, "count": 1, "min": 0.6837402224646448, "max": 0.6837402224646448}}} #metrics {"StartTime": 1616444530.0337682, "EndTime": 1616444530.0337765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843825392547981, "count": 1, "min": 0.6843825392547981, "max": 0.6843825392547981}}} #metrics {"StartTime": 1616444530.0338123, "EndTime": 1616444530.0338216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402527819125, "count": 1, "min": 0.6837402527819125, "max": 0.6837402527819125}}} [03/22/2021 20:22:10 INFO 140710537553728] #quality_metric: host=algo-1, epoch=9, validation binary_classification_cross_entropy_objective <loss>=0.15581602969870872 [03/22/2021 20:22:10 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:22:10 INFO 140710537553728] Epoch 9: Loss improved. Updating best model [03/22/2021 20:22:10 INFO 140710537553728] Saving model for epoch: 9 [03/22/2021 20:22:10 INFO 140710537553728] Saved checkpoint to "/tmp/tmp5scdn5q0/mx-mod-0000.params" [03/22/2021 20:22:10 INFO 140710537553728] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs #metrics {"StartTime": 1616444516.7746472, "EndTime": 1616444530.0398781, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4521610.0, "count": 1, "min": 4521610, "max": 4521610}, "Total Batches Seen": {"sum": 4522.0, "count": 1, "min": 4522, "max": 4522}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:22:10 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=33995.392330169925 records/second [2021-03-22 20:22:20.929] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 23, "duration": 10886, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444540.9295886, "EndTime": 1616444540.9298143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15461682289971246, "count": 1, "min": 0.15461682289971246, "max": 0.15461682289971246}}} #metrics {"StartTime": 1616444540.9299197, "EndTime": 1616444540.929937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1407611908806695, "count": 1, "min": 0.1407611908806695, "max": 0.1407611908806695}}} #metrics {"StartTime": 1616444540.929981, "EndTime": 1616444540.929992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15611502063327365, "count": 1, "min": 0.15611502063327365, "max": 0.15611502063327365}}} #metrics {"StartTime": 1616444540.9300337, "EndTime": 1616444540.930045, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14099027854071722, "count": 1, "min": 0.14099027854071722, "max": 0.14099027854071722}}} #metrics {"StartTime": 1616444540.930083, "EndTime": 1616444540.930093, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384499383714464, "count": 1, "min": 0.1384499383714464, "max": 0.1384499383714464}}} #metrics {"StartTime": 1616444540.9301312, "EndTime": 1616444540.9301412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14113318920559353, "count": 1, "min": 0.14113318920559353, "max": 0.14113318920559353}}} #metrics {"StartTime": 1616444540.930181, "EndTime": 1616444540.9301925, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13844874031914606, "count": 1, "min": 0.13844874031914606, "max": 0.13844874031914606}}} #metrics {"StartTime": 1616444540.930234, "EndTime": 1616444540.9302447, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14113317460801866, "count": 1, "min": 0.14113317460801866, "max": 0.14113317460801866}}} #metrics {"StartTime": 1616444540.9302826, "EndTime": 1616444540.9302938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17467522847493488, "count": 1, "min": 0.17467522847493488, "max": 0.17467522847493488}}} #metrics {"StartTime": 1616444540.9303334, "EndTime": 1616444540.9303439, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336875783284506, "count": 1, "min": 0.17336875783284506, "max": 0.17336875783284506}}} #metrics {"StartTime": 1616444540.9303818, "EndTime": 1616444540.9303918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17425065897623698, "count": 1, "min": 0.17425065897623698, "max": 0.17425065897623698}}} #metrics {"StartTime": 1616444540.930469, "EndTime": 1616444540.9304817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336943840874566, "count": 1, "min": 0.17336943840874566, "max": 0.17336943840874566}}} #metrics {"StartTime": 1616444540.930526, "EndTime": 1616444540.9305372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17326279062906902, "count": 1, "min": 0.17326279062906902, "max": 0.17326279062906902}}} #metrics {"StartTime": 1616444540.930578, "EndTime": 1616444540.9305885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17517168145073786, "count": 1, "min": 0.17517168145073786, "max": 0.17517168145073786}}} #metrics {"StartTime": 1616444540.9306288, "EndTime": 1616444540.9306395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17326268141004775, "count": 1, "min": 0.17326268141004775, "max": 0.17326268141004775}}} #metrics {"StartTime": 1616444540.930677, "EndTime": 1616444540.9306877, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17517204667833117, "count": 1, "min": 0.17517204667833117, "max": 0.17517204667833117}}} #metrics {"StartTime": 1616444540.9307277, "EndTime": 1616444540.9307384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476756738959418, "count": 1, "min": 0.4476756738959418, "max": 0.4476756738959418}}} #metrics {"StartTime": 1616444540.9307773, "EndTime": 1616444540.9307885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447774553765191, "count": 1, "min": 0.447774553765191, "max": 0.447774553765191}}} #metrics {"StartTime": 1616444540.9308262, "EndTime": 1616444540.9308372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476794751654731, "count": 1, "min": 0.4476794751654731, "max": 0.4476794751654731}}} #metrics {"StartTime": 1616444540.9308777, "EndTime": 1616444540.9308887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777454474555123, "count": 1, "min": 0.44777454474555123, "max": 0.44777454474555123}}} #metrics {"StartTime": 1616444540.9309294, "EndTime": 1616444540.93094, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44771401041666664, "count": 1, "min": 0.44771401041666664, "max": 0.44771401041666664}}} #metrics {"StartTime": 1616444540.9309769, "EndTime": 1616444540.9309878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487335224745009, "count": 1, "min": 0.4487335224745009, "max": 0.4487335224745009}}} #metrics {"StartTime": 1616444540.93103, "EndTime": 1616444540.9310412, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44771403733995224, "count": 1, "min": 0.44771403733995224, "max": 0.44771403733995224}}} #metrics {"StartTime": 1616444540.9310787, "EndTime": 1616444540.9310892, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448733510945638, "count": 1, "min": 0.448733510945638, "max": 0.448733510945638}}} #metrics {"StartTime": 1616444540.9311297, "EndTime": 1616444540.9311407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847294426812066, "count": 1, "min": 0.6847294426812066, "max": 0.6847294426812066}}} #metrics {"StartTime": 1616444540.931182, "EndTime": 1616444540.9311924, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848382786729601, "count": 1, "min": 0.6848382786729601, "max": 0.6848382786729601}}} #metrics {"StartTime": 1616444540.9312305, "EndTime": 1616444540.9312422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320271809896, "count": 1, "min": 0.6847320271809896, "max": 0.6847320271809896}}} #metrics {"StartTime": 1616444540.9312775, "EndTime": 1616444540.9312885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848382965766059, "count": 1, "min": 0.6848382965766059, "max": 0.6848382965766059}}} #metrics {"StartTime": 1616444540.9313269, "EndTime": 1616444540.931338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847614293077257, "count": 1, "min": 0.6847614293077257, "max": 0.6847614293077257}}} #metrics {"StartTime": 1616444540.9313755, "EndTime": 1616444540.9313865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863115862358941, "count": 1, "min": 0.6863115862358941, "max": 0.6863115862358941}}} #metrics {"StartTime": 1616444540.9314258, "EndTime": 1616444540.9314358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847616265190972, "count": 1, "min": 0.6847616265190972, "max": 0.6847616265190972}}} #metrics {"StartTime": 1616444540.931474, "EndTime": 1616444540.9314864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863116209581163, "count": 1, "min": 0.6863116209581163, "max": 0.6863116209581163}}} [03/22/2021 20:22:20 INFO 140710537553728] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.15461682289971246 [2021-03-22 20:22:21.960] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 32, "duration": 1015, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444542.649032, "EndTime": 1616444542.649099, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15560237822939535, "count": 1, "min": 0.15560237822939535, "max": 0.15560237822939535}}} #metrics {"StartTime": 1616444542.6491764, "EndTime": 1616444542.64919, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14202363083754657, "count": 1, "min": 0.14202363083754657, "max": 0.14202363083754657}}} #metrics {"StartTime": 1616444542.6492293, "EndTime": 1616444542.6492386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15687450769629824, "count": 1, "min": 0.15687450769629824, "max": 0.15687450769629824}}} #metrics {"StartTime": 1616444542.6492708, "EndTime": 1616444542.6492784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14222044586944987, "count": 1, "min": 0.14222044586944987, "max": 0.14222044586944987}}} #metrics {"StartTime": 1616444542.6493065, "EndTime": 1616444542.6493137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14015598523821923, "count": 1, "min": 0.14015598523821923, "max": 0.14015598523821923}}} #metrics {"StartTime": 1616444542.6493425, "EndTime": 1616444542.6493511, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1417255942991107, "count": 1, "min": 0.1417255942991107, "max": 0.1417255942991107}}} #metrics {"StartTime": 1616444542.6493845, "EndTime": 1616444542.6493933, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401550515611184, "count": 1, "min": 0.1401550515611184, "max": 0.1401550515611184}}} #metrics {"StartTime": 1616444542.649429, "EndTime": 1616444542.6494389, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14172505691200785, "count": 1, "min": 0.14172505691200785, "max": 0.14172505691200785}}} #metrics {"StartTime": 1616444542.6494658, "EndTime": 1616444542.6494746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17559406564065239, "count": 1, "min": 0.17559406564065239, "max": 0.17559406564065239}}} #metrics {"StartTime": 1616444542.649511, "EndTime": 1616444542.649521, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17417739135947913, "count": 1, "min": 0.17417739135947913, "max": 0.17417739135947913}}} #metrics {"StartTime": 1616444542.6495554, "EndTime": 1616444542.649565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17514242849304296, "count": 1, "min": 0.17514242849304296, "max": 0.17514242849304296}}} #metrics {"StartTime": 1616444542.6495948, "EndTime": 1616444542.649604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17418441149874192, "count": 1, "min": 0.17418441149874192, "max": 0.17418441149874192}}} #metrics {"StartTime": 1616444542.6496413, "EndTime": 1616444542.6496506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433640745825138, "count": 1, "min": 0.17433640745825138, "max": 0.17433640745825138}}} #metrics {"StartTime": 1616444542.6496806, "EndTime": 1616444542.6496909, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17602177583221765, "count": 1, "min": 0.17602177583221765, "max": 0.17602177583221765}}} #metrics {"StartTime": 1616444542.6497254, "EndTime": 1616444542.6497355, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743356305105965, "count": 1, "min": 0.1743356305105965, "max": 0.1743356305105965}}} #metrics {"StartTime": 1616444542.649769, "EndTime": 1616444542.6497781, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1760062260515241, "count": 1, "min": 0.1760062260515241, "max": 0.1760062260515241}}} #metrics {"StartTime": 1616444542.6498113, "EndTime": 1616444542.6498213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44883368063928897, "count": 1, "min": 0.44883368063928897, "max": 0.44883368063928897}}} #metrics {"StartTime": 1616444542.6498575, "EndTime": 1616444542.6498666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499252349111825, "count": 1, "min": 0.4499252349111825, "max": 0.4499252349111825}}} #metrics {"StartTime": 1616444542.649902, "EndTime": 1616444542.649912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490551980860969, "count": 1, "min": 0.4490551980860969, "max": 0.4490551980860969}}} #metrics {"StartTime": 1616444542.6499474, "EndTime": 1616444542.6499574, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44993462676758333, "count": 1, "min": 0.44993462676758333, "max": 0.44993462676758333}}} #metrics {"StartTime": 1616444542.6499906, "EndTime": 1616444542.6500003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449392251391476, "count": 1, "min": 0.449392251391476, "max": 0.449392251391476}}} #metrics {"StartTime": 1616444542.6500356, "EndTime": 1616444542.6500454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.450632935761348, "count": 1, "min": 0.450632935761348, "max": 0.450632935761348}}} #metrics {"StartTime": 1616444542.6500793, "EndTime": 1616444542.6500893, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44939114643534767, "count": 1, "min": 0.44939114643534767, "max": 0.44939114643534767}}} #metrics {"StartTime": 1616444542.6501243, "EndTime": 1616444542.6501348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.450633253821968, "count": 1, "min": 0.450633253821968, "max": 0.450633253821968}}} #metrics {"StartTime": 1616444542.6501675, "EndTime": 1616444542.6501768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847834328757505, "count": 1, "min": 0.6847834328757505, "max": 0.6847834328757505}}} #metrics {"StartTime": 1616444542.6502135, "EndTime": 1616444542.6502233, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853917017502419, "count": 1, "min": 0.6853917017502419, "max": 0.6853917017502419}}} #metrics {"StartTime": 1616444542.6502569, "EndTime": 1616444542.6502671, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847850995133992, "count": 1, "min": 0.6847850995133992, "max": 0.6847850995133992}}} #metrics {"StartTime": 1616444542.6503031, "EndTime": 1616444542.6503131, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855036539453679, "count": 1, "min": 0.6855036539453679, "max": 0.6855036539453679}}} #metrics {"StartTime": 1616444542.6503472, "EndTime": 1616444542.6503568, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684497985244326, "count": 1, "min": 0.684497985244326, "max": 0.684497985244326}}} #metrics {"StartTime": 1616444542.6503916, "EndTime": 1616444542.6504014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848288841443809, "count": 1, "min": 0.6848288841443809, "max": 0.6848288841443809}}} #metrics {"StartTime": 1616444542.6504347, "EndTime": 1616444542.6504443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684523326419697, "count": 1, "min": 0.684523326419697, "max": 0.684523326419697}}} #metrics {"StartTime": 1616444542.650478, "EndTime": 1616444542.6504872, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684828868985747, "count": 1, "min": 0.684828868985747, "max": 0.684828868985747}}} [03/22/2021 20:22:22 INFO 140710537553728] #quality_metric: host=algo-1, epoch=10, validation binary_classification_cross_entropy_objective <loss>=0.15560237822939535 [03/22/2021 20:22:22 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:22:22 INFO 140710537553728] Epoch 10: Loss improved. Updating best model [03/22/2021 20:22:22 INFO 140710537553728] Saving model for epoch: 10 [03/22/2021 20:22:22 INFO 140710537553728] Saved checkpoint to "/tmp/tmph338xsch/mx-mod-0000.params" [03/22/2021 20:22:22 INFO 140710537553728] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs #metrics {"StartTime": 1616444530.0425496, "EndTime": 1616444542.656602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4972571.0, "count": 1, "min": 4972571, "max": 4972571}, "Total Batches Seen": {"sum": 4973.0, "count": 1, "min": 4973, "max": 4973}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:22:22 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=35750.31592545624 records/second [2021-03-22 20:22:33.178] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 25, "duration": 10519, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444553.1788716, "EndTime": 1616444553.178946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15443608176337348, "count": 1, "min": 0.15443608176337348, "max": 0.15443608176337348}}} #metrics {"StartTime": 1616444553.1790285, "EndTime": 1616444553.179041, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1403178591071235, "count": 1, "min": 0.1403178591071235, "max": 0.1403178591071235}}} #metrics {"StartTime": 1616444553.1790783, "EndTime": 1616444553.1790872, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15556796140882703, "count": 1, "min": 0.15556796140882703, "max": 0.15556796140882703}}} #metrics {"StartTime": 1616444553.1791222, "EndTime": 1616444553.17913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14050594182332357, "count": 1, "min": 0.14050594182332357, "max": 0.14050594182332357}}} #metrics {"StartTime": 1616444553.1791584, "EndTime": 1616444553.1791663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13842714701334635, "count": 1, "min": 0.13842714701334635, "max": 0.13842714701334635}}} #metrics {"StartTime": 1616444553.1792371, "EndTime": 1616444553.1792474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102241065131293, "count": 1, "min": 0.14102241065131293, "max": 0.14102241065131293}}} #metrics {"StartTime": 1616444553.1792777, "EndTime": 1616444553.179285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13842593931410047, "count": 1, "min": 0.13842593931410047, "max": 0.13842593931410047}}} #metrics {"StartTime": 1616444553.1793144, "EndTime": 1616444553.1793215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102239503648545, "count": 1, "min": 0.14102239503648545, "max": 0.14102239503648545}}} #metrics {"StartTime": 1616444553.179349, "EndTime": 1616444553.179356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1745928789944119, "count": 1, "min": 0.1745928789944119, "max": 0.1745928789944119}}} #metrics {"StartTime": 1616444553.1793852, "EndTime": 1616444553.1793923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733639606051975, "count": 1, "min": 0.1733639606051975, "max": 0.1733639606051975}}} #metrics {"StartTime": 1616444553.1794183, "EndTime": 1616444553.1794255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17408618103027343, "count": 1, "min": 0.17408618103027343, "max": 0.17408618103027343}}} #metrics {"StartTime": 1616444553.179452, "EndTime": 1616444553.1794593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336453264024523, "count": 1, "min": 0.17336453264024523, "max": 0.17336453264024523}}} #metrics {"StartTime": 1616444553.1794868, "EndTime": 1616444553.179494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17324363878038193, "count": 1, "min": 0.17324363878038193, "max": 0.17324363878038193}}} #metrics {"StartTime": 1616444553.1795204, "EndTime": 1616444553.1795273, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514980526394314, "count": 1, "min": 0.17514980526394314, "max": 0.17514980526394314}}} #metrics {"StartTime": 1616444553.1795535, "EndTime": 1616444553.1795604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17324357821994357, "count": 1, "min": 0.17324357821994357, "max": 0.17324357821994357}}} #metrics {"StartTime": 1616444553.179587, "EndTime": 1616444553.179594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514994737413195, "count": 1, "min": 0.17514994737413195, "max": 0.17514994737413195}}} #metrics {"StartTime": 1616444553.17962, "EndTime": 1616444553.179627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767094936794705, "count": 1, "min": 0.44767094936794705, "max": 0.44767094936794705}}} #metrics {"StartTime": 1616444553.1796534, "EndTime": 1616444553.1796606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777068332248265, "count": 1, "min": 0.44777068332248265, "max": 0.44777068332248265}}} #metrics {"StartTime": 1616444553.1796865, "EndTime": 1616444553.1796942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795075141059, "count": 1, "min": 0.4476795075141059, "max": 0.4476795075141059}}} #metrics {"StartTime": 1616444553.1797206, "EndTime": 1616444553.1797276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477706713189019, "count": 1, "min": 0.4477706713189019, "max": 0.4477706713189019}}} #metrics {"StartTime": 1616444553.1797578, "EndTime": 1616444553.1797647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476882770453559, "count": 1, "min": 0.4476882770453559, "max": 0.4476882770453559}}} #metrics {"StartTime": 1616444553.179792, "EndTime": 1616444553.1797988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486791400146484, "count": 1, "min": 0.4486791400146484, "max": 0.4486791400146484}}} #metrics {"StartTime": 1616444553.179825, "EndTime": 1616444553.1798322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476882986111111, "count": 1, "min": 0.4476882986111111, "max": 0.4476882986111111}}} #metrics {"StartTime": 1616444553.1798584, "EndTime": 1616444553.1798656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448679135538737, "count": 1, "min": 0.448679135538737, "max": 0.448679135538737}}} #metrics {"StartTime": 1616444553.1798918, "EndTime": 1616444553.1798987, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847284865993923, "count": 1, "min": 0.6847284865993923, "max": 0.6847284865993923}}} #metrics {"StartTime": 1616444553.179925, "EndTime": 1616444553.179932, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848348379177517, "count": 1, "min": 0.6848348379177517, "max": 0.6848348379177517}}} #metrics {"StartTime": 1616444553.1799626, "EndTime": 1616444553.17997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320682779948, "count": 1, "min": 0.6847320682779948, "max": 0.6847320682779948}}} #metrics {"StartTime": 1616444553.18, "EndTime": 1616444553.1800077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684835230984158, "count": 1, "min": 0.684835230984158, "max": 0.684835230984158}}} #metrics {"StartTime": 1616444553.1800349, "EndTime": 1616444553.180042, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847499217393663, "count": 1, "min": 0.6847499217393663, "max": 0.6847499217393663}}} #metrics {"StartTime": 1616444553.1800714, "EndTime": 1616444553.1800787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657504611546, "count": 1, "min": 0.6862657504611546, "max": 0.6862657504611546}}} #metrics {"StartTime": 1616444553.1801054, "EndTime": 1616444553.1801126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847497011990017, "count": 1, "min": 0.6847497011990017, "max": 0.6847497011990017}}} #metrics {"StartTime": 1616444553.180139, "EndTime": 1616444553.180146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657687717014, "count": 1, "min": 0.6862657687717014, "max": 0.6862657687717014}}} [03/22/2021 20:22:33 INFO 140710537553728] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.15443608176337348 [2021-03-22 20:22:34.296] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 35, "duration": 1099, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444554.9629695, "EndTime": 1616444554.9630375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15545974360600165, "count": 1, "min": 0.15545974360600165, "max": 0.15545974360600165}}} #metrics {"StartTime": 1616444554.963114, "EndTime": 1616444554.9631283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14165477498913776, "count": 1, "min": 0.14165477498913776, "max": 0.14165477498913776}}} #metrics {"StartTime": 1616444554.963167, "EndTime": 1616444554.963177, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1563369862636142, "count": 1, "min": 0.1563369862636142, "max": 0.1563369862636142}}} #metrics {"StartTime": 1616444554.9632142, "EndTime": 1616444554.9632242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14181767866842837, "count": 1, "min": 0.14181767866842837, "max": 0.14181767866842837}}} #metrics {"StartTime": 1616444554.9632576, "EndTime": 1616444554.963267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14012782902334395, "count": 1, "min": 0.14012782902334395, "max": 0.14012782902334395}}} #metrics {"StartTime": 1616444554.9632986, "EndTime": 1616444554.9633079, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414400005628184, "count": 1, "min": 0.1414400005628184, "max": 0.1414400005628184}}} #metrics {"StartTime": 1616444554.9633412, "EndTime": 1616444554.963351, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14012671723229592, "count": 1, "min": 0.14012671723229592, "max": 0.14012671723229592}}} #metrics {"StartTime": 1616444554.9633777, "EndTime": 1616444554.9633873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414396906228951, "count": 1, "min": 0.1414396906228951, "max": 0.1414396906228951}}} #metrics {"StartTime": 1616444554.963418, "EndTime": 1616444554.963427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17552629098288236, "count": 1, "min": 0.17552629098288236, "max": 0.17552629098288236}}} #metrics {"StartTime": 1616444554.963459, "EndTime": 1616444554.9634686, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741904597936295, "count": 1, "min": 0.1741904597936295, "max": 0.1741904597936295}}} #metrics {"StartTime": 1616444554.9634972, "EndTime": 1616444554.9635067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17498462982204804, "count": 1, "min": 0.17498462982204804, "max": 0.17498462982204804}}} #metrics {"StartTime": 1616444554.9635396, "EndTime": 1616444554.9635491, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741967203770628, "count": 1, "min": 0.1741967203770628, "max": 0.1741967203770628}}} #metrics {"StartTime": 1616444554.9635818, "EndTime": 1616444554.9635906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427782319593202, "count": 1, "min": 0.17427782319593202, "max": 0.17427782319593202}}} #metrics {"StartTime": 1616444554.9636192, "EndTime": 1616444554.9636297, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1765536294923261, "count": 1, "min": 0.1765536294923261, "max": 0.1765536294923261}}} #metrics {"StartTime": 1616444554.9636598, "EndTime": 1616444554.9636698, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174277490518058, "count": 1, "min": 0.174277490518058, "max": 0.174277490518058}}} #metrics {"StartTime": 1616444554.9636998, "EndTime": 1616444554.9637086, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17654700395124948, "count": 1, "min": 0.17654700395124948, "max": 0.17654700395124948}}} #metrics {"StartTime": 1616444554.9637396, "EndTime": 1616444554.9637456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44880743617175717, "count": 1, "min": 0.44880743617175717, "max": 0.44880743617175717}}} #metrics {"StartTime": 1616444554.9637737, "EndTime": 1616444554.963781, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500131057216826, "count": 1, "min": 0.4500131057216826, "max": 0.4500131057216826}}} #metrics {"StartTime": 1616444554.9638076, "EndTime": 1616444554.963816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44906298204455497, "count": 1, "min": 0.44906298204455497, "max": 0.44906298204455497}}} #metrics {"StartTime": 1616444554.9638376, "EndTime": 1616444554.963843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.450019927648274, "count": 1, "min": 0.450019927648274, "max": 0.450019927648274}}} #metrics {"StartTime": 1616444554.963861, "EndTime": 1616444554.9638658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44980805244601446, "count": 1, "min": 0.44980805244601446, "max": 0.44980805244601446}}} #metrics {"StartTime": 1616444554.9638875, "EndTime": 1616444554.9638953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4508171775862535, "count": 1, "min": 0.4508171775862535, "max": 0.4508171775862535}}} #metrics {"StartTime": 1616444554.9639266, "EndTime": 1616444554.9639351, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498078036820062, "count": 1, "min": 0.4498078036820062, "max": 0.4498078036820062}}} #metrics {"StartTime": 1616444554.9639673, "EndTime": 1616444554.963977, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45081725987597987, "count": 1, "min": 0.45081725987597987, "max": 0.45081725987597987}}} #metrics {"StartTime": 1616444554.9640136, "EndTime": 1616444554.9640234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847868703666553, "count": 1, "min": 0.6847868703666553, "max": 0.6847868703666553}}} #metrics {"StartTime": 1616444554.9640608, "EndTime": 1616444554.96407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.685490803213561, "count": 1, "min": 0.685490803213561, "max": 0.685490803213561}}} #metrics {"StartTime": 1616444554.9641097, "EndTime": 1616444554.9641185, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848020024728496, "count": 1, "min": 0.6848020024728496, "max": 0.6848020024728496}}} #metrics {"StartTime": 1616444554.9641569, "EndTime": 1616444554.9641662, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856148170794666, "count": 1, "min": 0.6856148170794666, "max": 0.6856148170794666}}} #metrics {"StartTime": 1616444554.9642036, "EndTime": 1616444554.964212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845315231802364, "count": 1, "min": 0.6845315231802364, "max": 0.6845315231802364}}} #metrics {"StartTime": 1616444554.9642453, "EndTime": 1616444554.9642537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849504011667471, "count": 1, "min": 0.6849504011667471, "max": 0.6849504011667471}}} #metrics {"StartTime": 1616444554.964302, "EndTime": 1616444554.964312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845795441079863, "count": 1, "min": 0.6845795441079863, "max": 0.6845795441079863}}} #metrics {"StartTime": 1616444554.9643428, "EndTime": 1616444554.96435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849504057684752, "count": 1, "min": 0.6849504057684752, "max": 0.6849504057684752}}} [03/22/2021 20:22:34 INFO 140710537553728] #quality_metric: host=algo-1, epoch=11, validation binary_classification_cross_entropy_objective <loss>=0.15545974360600165 [03/22/2021 20:22:34 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:22:34 INFO 140710537553728] Epoch 11: Loss improved. Updating best model [03/22/2021 20:22:34 INFO 140710537553728] Saving model for epoch: 11 [03/22/2021 20:22:34 INFO 140710537553728] Saved checkpoint to "/tmp/tmp_3r3pgvu/mx-mod-0000.params" [03/22/2021 20:22:34 INFO 140710537553728] #progress_metric: host=algo-1, completed 80.0 % of epochs #metrics {"StartTime": 1616444542.6593325, "EndTime": 1616444554.9729183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5423532.0, "count": 1, "min": 5423532, "max": 5423532}, "Total Batches Seen": {"sum": 5424.0, "count": 1, "min": 5424, "max": 5424}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:22:34 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=36622.71625454028 records/second [2021-03-22 20:22:45.847] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 27, "duration": 10871, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444565.8473368, "EndTime": 1616444565.8474243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15431584598117404, "count": 1, "min": 0.15431584598117404, "max": 0.15431584598117404}}} #metrics {"StartTime": 1616444565.847511, "EndTime": 1616444565.8475275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13996640887790257, "count": 1, "min": 0.13996640887790257, "max": 0.13996640887790257}}} #metrics {"StartTime": 1616444565.847574, "EndTime": 1616444565.8475862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1550187654791938, "count": 1, "min": 0.1550187654791938, "max": 0.1550187654791938}}} #metrics {"StartTime": 1616444565.8476195, "EndTime": 1616444565.8476315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14012161109076607, "count": 1, "min": 0.14012161109076607, "max": 0.14012161109076607}}} #metrics {"StartTime": 1616444565.847673, "EndTime": 1616444565.8476844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13841161253187392, "count": 1, "min": 0.13841161253187392, "max": 0.13841161253187392}}} #metrics {"StartTime": 1616444565.8477216, "EndTime": 1616444565.8477323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091814492119684, "count": 1, "min": 0.14091814492119684, "max": 0.14091814492119684}}} #metrics {"StartTime": 1616444565.8477688, "EndTime": 1616444565.8477786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13841047910902235, "count": 1, "min": 0.13841047910902235, "max": 0.13841047910902235}}} #metrics {"StartTime": 1616444565.8478146, "EndTime": 1616444565.847824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091812847561305, "count": 1, "min": 0.14091812847561305, "max": 0.14091812847561305}}} #metrics {"StartTime": 1616444565.8478622, "EndTime": 1616444565.8478737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17453608391655817, "count": 1, "min": 0.17453608391655817, "max": 0.17453608391655817}}} #metrics {"StartTime": 1616444565.8479102, "EndTime": 1616444565.8479197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733587750922309, "count": 1, "min": 0.1733587750922309, "max": 0.1733587750922309}}} #metrics {"StartTime": 1616444565.8479612, "EndTime": 1616444565.847972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17393236419677735, "count": 1, "min": 0.17393236419677735, "max": 0.17393236419677735}}} #metrics {"StartTime": 1616444565.8480117, "EndTime": 1616444565.848022, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335952277289496, "count": 1, "min": 0.17335952277289496, "max": 0.17335952277289496}}} #metrics {"StartTime": 1616444565.8480594, "EndTime": 1616444565.848069, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17322929141574436, "count": 1, "min": 0.17322929141574436, "max": 0.17322929141574436}}} #metrics {"StartTime": 1616444565.8480995, "EndTime": 1616444565.848108, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510965911865234, "count": 1, "min": 0.17510965911865234, "max": 0.17510965911865234}}} #metrics {"StartTime": 1616444565.8481407, "EndTime": 1616444565.8481512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732292493693034, "count": 1, "min": 0.1732292493693034, "max": 0.1732292493693034}}} #metrics {"StartTime": 1616444565.8481886, "EndTime": 1616444565.8481984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510990464952256, "count": 1, "min": 0.17510990464952256, "max": 0.17510990464952256}}} #metrics {"StartTime": 1616444565.8482382, "EndTime": 1616444565.8482487, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767023851182725, "count": 1, "min": 0.44767023851182725, "max": 0.44767023851182725}}} #metrics {"StartTime": 1616444565.8483117, "EndTime": 1616444565.8483229, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654640028212, "count": 1, "min": 0.4477654640028212, "max": 0.4477654640028212}}} #metrics {"StartTime": 1616444565.8483694, "EndTime": 1616444565.84838, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795311143663, "count": 1, "min": 0.4476795311143663, "max": 0.4476795311143663}}} #metrics {"StartTime": 1616444565.8484242, "EndTime": 1616444565.8484347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654561360677, "count": 1, "min": 0.4477654561360677, "max": 0.4477654561360677}}} #metrics {"StartTime": 1616444565.8484786, "EndTime": 1616444565.8484893, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476796061876085, "count": 1, "min": 0.4476796061876085, "max": 0.4476796061876085}}} #metrics {"StartTime": 1616444565.848532, "EndTime": 1616444565.8485425, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486405508083767, "count": 1, "min": 0.4486405508083767, "max": 0.4486405508083767}}} #metrics {"StartTime": 1616444565.8485854, "EndTime": 1616444565.8485966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795927598741, "count": 1, "min": 0.4476795927598741, "max": 0.4476795927598741}}} #metrics {"StartTime": 1616444565.8486388, "EndTime": 1616444565.8486493, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486405505371094, "count": 1, "min": 0.4486405505371094, "max": 0.4486405505371094}}} #metrics {"StartTime": 1616444565.8486867, "EndTime": 1616444565.848696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847279062228733, "count": 1, "min": 0.6847279062228733, "max": 0.6847279062228733}}} #metrics {"StartTime": 1616444565.848732, "EndTime": 1616444565.8487415, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848310275607639, "count": 1, "min": 0.6848310275607639, "max": 0.6848310275607639}}} #metrics {"StartTime": 1616444565.8487833, "EndTime": 1616444565.848793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321385362414, "count": 1, "min": 0.6847321385362414, "max": 0.6847321385362414}}} #metrics {"StartTime": 1616444565.8488333, "EndTime": 1616444565.848843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684831348063151, "count": 1, "min": 0.684831348063151, "max": 0.684831348063151}}} #metrics {"StartTime": 1616444565.8488839, "EndTime": 1616444565.8488936, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847416540527343, "count": 1, "min": 0.6847416540527343, "max": 0.6847416540527343}}} #metrics {"StartTime": 1616444565.8489308, "EndTime": 1616444565.8489401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862042363823785, "count": 1, "min": 0.6862042363823785, "max": 0.6862042363823785}}} #metrics {"StartTime": 1616444565.8489797, "EndTime": 1616444565.8489895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847413397894965, "count": 1, "min": 0.6847413397894965, "max": 0.6847413397894965}}} #metrics {"StartTime": 1616444565.8490283, "EndTime": 1616444565.849038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686204245469835, "count": 1, "min": 0.686204245469835, "max": 0.686204245469835}}} [03/22/2021 20:22:45 INFO 140710537553728] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.15431584598117404 [2021-03-22 20:22:46.939] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 38, "duration": 1076, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444567.7883072, "EndTime": 1616444567.7883708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553652810906611, "count": 1, "min": 0.1553652810906611, "max": 0.1553652810906611}}} #metrics {"StartTime": 1616444567.7884452, "EndTime": 1616444567.7884586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14136650649837637, "count": 1, "min": 0.14136650649837637, "max": 0.14136650649837637}}} #metrics {"StartTime": 1616444567.7884936, "EndTime": 1616444567.7885036, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15580257451637894, "count": 1, "min": 0.15580257451637894, "max": 0.15580257451637894}}} #metrics {"StartTime": 1616444567.7885294, "EndTime": 1616444567.7885382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14150081957319177, "count": 1, "min": 0.14150081957319177, "max": 0.14150081957319177}}} #metrics {"StartTime": 1616444567.788572, "EndTime": 1616444567.7885818, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14011417880894889, "count": 1, "min": 0.14011417880894889, "max": 0.14011417880894889}}} #metrics {"StartTime": 1616444567.7886102, "EndTime": 1616444567.7886193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113160411326497, "count": 1, "min": 0.14113160411326497, "max": 0.14113160411326497}}} #metrics {"StartTime": 1616444567.788648, "EndTime": 1616444567.788655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14011322151415523, "count": 1, "min": 0.14011322151415523, "max": 0.14011322151415523}}} #metrics {"StartTime": 1616444567.7886822, "EndTime": 1616444567.78869, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113150260455645, "count": 1, "min": 0.14113150260455645, "max": 0.14113150260455645}}} #metrics {"StartTime": 1616444567.7887187, "EndTime": 1616444567.7887263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17547974802192823, "count": 1, "min": 0.17547974802192823, "max": 0.17547974802192823}}} #metrics {"StartTime": 1616444567.7887588, "EndTime": 1616444567.7887673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420016849254577, "count": 1, "min": 0.17420016849254577, "max": 0.17420016849254577}}} #metrics {"StartTime": 1616444567.7888002, "EndTime": 1616444567.7888098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17484027469371763, "count": 1, "min": 0.17484027469371763, "max": 0.17484027469371763}}} #metrics {"StartTime": 1616444567.788841, "EndTime": 1616444567.7888498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.174205229310717, "count": 1, "min": 0.174205229310717, "max": 0.174205229310717}}} #metrics {"StartTime": 1616444567.7888787, "EndTime": 1616444567.7888875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17423933671048206, "count": 1, "min": 0.17423933671048206, "max": 0.17423933671048206}}} #metrics {"StartTime": 1616444567.7889225, "EndTime": 1616444567.7889323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659003078588595, "count": 1, "min": 0.17659003078588595, "max": 0.17659003078588595}}} #metrics {"StartTime": 1616444567.7889605, "EndTime": 1616444567.7889695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17423918884613, "count": 1, "min": 0.17423918884613, "max": 0.17423918884613}}} #metrics {"StartTime": 1616444567.7889965, "EndTime": 1616444567.7890058, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659058096308605, "count": 1, "min": 0.17659058096308605, "max": 0.17659058096308605}}} #metrics {"StartTime": 1616444567.7890358, "EndTime": 1616444567.7890444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487823475500529, "count": 1, "min": 0.4487823475500529, "max": 0.4487823475500529}}} #metrics {"StartTime": 1616444567.7890737, "EndTime": 1616444567.7890813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501426979648278, "count": 1, "min": 0.4501426979648278, "max": 0.4501426979648278}}} #metrics {"StartTime": 1616444567.7891123, "EndTime": 1616444567.7891226, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490682908146648, "count": 1, "min": 0.4490682908146648, "max": 0.4490682908146648}}} #metrics {"StartTime": 1616444567.7891588, "EndTime": 1616444567.7891681, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45014733434125254, "count": 1, "min": 0.45014733434125254, "max": 0.45014733434125254}}} #metrics {"StartTime": 1616444567.7892017, "EndTime": 1616444567.789212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44965558528308014, "count": 1, "min": 0.44965558528308014, "max": 0.44965558528308014}}} #metrics {"StartTime": 1616444567.7892458, "EndTime": 1616444567.789255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4507006618302829, "count": 1, "min": 0.4507006618302829, "max": 0.4507006618302829}}} #metrics {"StartTime": 1616444567.7892907, "EndTime": 1616444567.7893007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496558789816101, "count": 1, "min": 0.4496558789816101, "max": 0.4496558789816101}}} #metrics {"StartTime": 1616444567.7893336, "EndTime": 1616444567.7893429, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45070064775440866, "count": 1, "min": 0.45070064775440866, "max": 0.45070064775440866}}} #metrics {"StartTime": 1616444567.7893758, "EndTime": 1616444567.7893846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847838129243551, "count": 1, "min": 0.6847838129243551, "max": 0.6847838129243551}}} #metrics {"StartTime": 1616444567.789419, "EndTime": 1616444567.7894285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856185174102539, "count": 1, "min": 0.6856185174102539, "max": 0.6856185174102539}}} #metrics {"StartTime": 1616444567.7894619, "EndTime": 1616444567.7894688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174374810301, "count": 1, "min": 0.6848174374810301, "max": 0.6848174374810301}}} #metrics {"StartTime": 1616444567.7894924, "EndTime": 1616444567.7894976, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857288728057228, "count": 1, "min": 0.6857288728057228, "max": 0.6857288728057228}}} #metrics {"StartTime": 1616444567.7895267, "EndTime": 1616444567.789535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846795342462122, "count": 1, "min": 0.6846795342462122, "max": 0.6846795342462122}}} #metrics {"StartTime": 1616444567.789566, "EndTime": 1616444567.7895744, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053067778323, "count": 1, "min": 0.6855053067778323, "max": 0.6855053067778323}}} #metrics {"StartTime": 1616444567.7896092, "EndTime": 1616444567.7896178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847120378760554, "count": 1, "min": 0.6847120378760554, "max": 0.6847120378760554}}} #metrics {"StartTime": 1616444567.7896533, "EndTime": 1616444567.7896621, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053105674908, "count": 1, "min": 0.6855053105674908, "max": 0.6855053105674908}}} [03/22/2021 20:22:47 INFO 140710537553728] #quality_metric: host=algo-1, epoch=12, validation binary_classification_cross_entropy_objective <loss>=0.1553652810906611 [03/22/2021 20:22:47 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=sampled_accuracy, value=0.9505588078765301 [03/22/2021 20:22:47 INFO 140710537553728] Epoch 12: Loss improved. Updating best model [03/22/2021 20:22:47 INFO 140710537553728] Saving model for epoch: 12 [03/22/2021 20:22:47 INFO 140710537553728] Saved checkpoint to "/tmp/tmp_f6w2wc9/mx-mod-0000.params" [03/22/2021 20:22:47 INFO 140710537553728] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs #metrics {"StartTime": 1616444554.9757912, "EndTime": 1616444567.7952995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5874493.0, "count": 1, "min": 5874493, "max": 5874493}, "Total Batches Seen": {"sum": 5875.0, "count": 1, "min": 5875, "max": 5875}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:22:47 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=35177.4132792877 records/second [2021-03-22 20:22:58.233] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 29, "duration": 10435, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444578.2337415, "EndTime": 1616444578.233806, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15423655368381076, "count": 1, "min": 0.15423655368381076, "max": 0.15423655368381076}}} #metrics {"StartTime": 1616444578.2338831, "EndTime": 1616444578.2338977, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13968034644232855, "count": 1, "min": 0.13968034644232855, "max": 0.13968034644232855}}} #metrics {"StartTime": 1616444578.2339444, "EndTime": 1616444578.2339556, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15447604619344074, "count": 1, "min": 0.15447604619344074, "max": 0.15447604619344074}}} #metrics {"StartTime": 1616444578.2339964, "EndTime": 1616444578.234007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13980974077012803, "count": 1, "min": 0.13980974077012803, "max": 0.13980974077012803}}} #metrics {"StartTime": 1616444578.2340477, "EndTime": 1616444578.2340577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384010927327474, "count": 1, "min": 0.1384010927327474, "max": 0.1384010927327474}}} #metrics {"StartTime": 1616444578.2340984, "EndTime": 1616444578.2341092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1408057483757867, "count": 1, "min": 0.1408057483757867, "max": 0.1408057483757867}}} #metrics {"StartTime": 1616444578.2341545, "EndTime": 1616444578.2341654, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839994322035049, "count": 1, "min": 0.13839994322035049, "max": 0.13839994322035049}}} #metrics {"StartTime": 1616444578.2342103, "EndTime": 1616444578.2342212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14080574039035373, "count": 1, "min": 0.14080574039035373, "max": 0.14080574039035373}}} #metrics {"StartTime": 1616444578.2342656, "EndTime": 1616444578.2342765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17449707041422527, "count": 1, "min": 0.17449707041422527, "max": 0.17449707041422527}}} #metrics {"StartTime": 1616444578.2343152, "EndTime": 1616444578.234325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733534198337131, "count": 1, "min": 0.1733534198337131, "max": 0.1733534198337131}}} #metrics {"StartTime": 1616444578.2343647, "EndTime": 1616444578.234374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737940789794922, "count": 1, "min": 0.1737940789794922, "max": 0.1737940789794922}}} #metrics {"StartTime": 1616444578.2344081, "EndTime": 1616444578.234418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733537387424045, "count": 1, "min": 0.1733537387424045, "max": 0.1733537387424045}}} #metrics {"StartTime": 1616444578.2344558, "EndTime": 1616444578.2344651, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321976637098524, "count": 1, "min": 0.17321976637098524, "max": 0.17321976637098524}}} #metrics {"StartTime": 1616444578.2345006, "EndTime": 1616444578.2345107, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505044481065538, "count": 1, "min": 0.17505044481065538, "max": 0.17505044481065538}}} #metrics {"StartTime": 1616444578.234549, "EndTime": 1616444578.2345595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321976138644748, "count": 1, "min": 0.17321976138644748, "max": 0.17321976138644748}}} #metrics {"StartTime": 1616444578.234599, "EndTime": 1616444578.2346094, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505075673421225, "count": 1, "min": 0.17505075673421225, "max": 0.17505075673421225}}} #metrics {"StartTime": 1616444578.2346516, "EndTime": 1616444578.2346616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476710454644097, "count": 1, "min": 0.4476710454644097, "max": 0.4476710454644097}}} #metrics {"StartTime": 1616444578.2347004, "EndTime": 1616444578.2347116, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44776187872992623, "count": 1, "min": 0.44776187872992623, "max": 0.44776187872992623}}} #metrics {"StartTime": 1616444578.2347543, "EndTime": 1616444578.2347648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767954427083334, "count": 1, "min": 0.44767954427083334, "max": 0.44767954427083334}}} #metrics {"StartTime": 1616444578.2348046, "EndTime": 1616444578.234816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44776187649197047, "count": 1, "min": 0.44776187649197047, "max": 0.44776187649197047}}} #metrics {"StartTime": 1616444578.2348576, "EndTime": 1616444578.2348685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768250189887154, "count": 1, "min": 0.44768250189887154, "max": 0.44768250189887154}}} #metrics {"StartTime": 1616444578.234912, "EndTime": 1616444578.2349236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485966553412543, "count": 1, "min": 0.4485966553412543, "max": 0.4485966553412543}}} #metrics {"StartTime": 1616444578.2349677, "EndTime": 1616444578.2349796, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476824925401476, "count": 1, "min": 0.4476824925401476, "max": 0.4476824925401476}}} #metrics {"StartTime": 1616444578.2350204, "EndTime": 1616444578.2350318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485966539171007, "count": 1, "min": 0.4485966539171007, "max": 0.4485966539171007}}} #metrics {"StartTime": 1616444578.2350714, "EndTime": 1616444578.235084, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684727492811415, "count": 1, "min": 0.684727492811415, "max": 0.684727492811415}}} #metrics {"StartTime": 1616444578.2351239, "EndTime": 1616444578.235135, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848278359646267, "count": 1, "min": 0.6848278359646267, "max": 0.6848278359646267}}} #metrics {"StartTime": 1616444578.2351794, "EndTime": 1616444578.2351913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321911621094, "count": 1, "min": 0.6847321911621094, "max": 0.6847321911621094}}} #metrics {"StartTime": 1616444578.2352352, "EndTime": 1616444578.235247, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848278675672743, "count": 1, "min": 0.6848278675672743, "max": 0.6848278675672743}}} #metrics {"StartTime": 1616444578.2352924, "EndTime": 1616444578.2353039, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847360725911459, "count": 1, "min": 0.6847360725911459, "max": 0.6847360725911459}}} #metrics {"StartTime": 1616444578.2353497, "EndTime": 1616444578.2353623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861613461642795, "count": 1, "min": 0.6861613461642795, "max": 0.6861613461642795}}} #metrics {"StartTime": 1616444578.2354066, "EndTime": 1616444578.2354183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847359556749132, "count": 1, "min": 0.6847359556749132, "max": 0.6847359556749132}}} #metrics {"StartTime": 1616444578.2354598, "EndTime": 1616444578.2354732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686161353624132, "count": 1, "min": 0.686161353624132, "max": 0.686161353624132}}} [03/22/2021 20:22:58 INFO 140710537553728] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.15423655368381076 [2021-03-22 20:22:59.301] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 41, "duration": 1049, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444579.9978888, "EndTime": 1616444579.9979634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15530284362543934, "count": 1, "min": 0.15530284362543934, "max": 0.15530284362543934}}} #metrics {"StartTime": 1616444579.9980412, "EndTime": 1616444579.9980526, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113691795881025, "count": 1, "min": 0.14113691795881025, "max": 0.14113691795881025}}} #metrics {"StartTime": 1616444579.9980838, "EndTime": 1616444579.9980922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1552788920366153, "count": 1, "min": 0.1552788920366153, "max": 0.1552788920366153}}} #metrics {"StartTime": 1616444579.9981217, "EndTime": 1616444579.9981294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14124816487142966, "count": 1, "min": 0.14124816487142966, "max": 0.14124816487142966}}} #metrics {"StartTime": 1616444579.9981625, "EndTime": 1616444579.9981713, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010644222122146, "count": 1, "min": 0.14010644222122146, "max": 0.14010644222122146}}} #metrics {"StartTime": 1616444579.9982038, "EndTime": 1616444579.9982128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101316050390245, "count": 1, "min": 0.14101316050390245, "max": 0.14101316050390245}}} #metrics {"StartTime": 1616444579.9982457, "EndTime": 1616444579.9982543, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010536582287647, "count": 1, "min": 0.14010536582287647, "max": 0.14010536582287647}}} #metrics {"StartTime": 1616444579.9982827, "EndTime": 1616444579.99829, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101314893190967, "count": 1, "min": 0.14101314893190967, "max": 0.14101314893190967}}} #metrics {"StartTime": 1616444579.9983187, "EndTime": 1616444579.9983265, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17544788051332505, "count": 1, "min": 0.17544788051332505, "max": 0.17544788051332505}}} #metrics {"StartTime": 1616444579.9983587, "EndTime": 1616444579.9983673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420799738552548, "count": 1, "min": 0.17420799738552548, "max": 0.17420799738552548}}} #metrics {"StartTime": 1616444579.9983995, "EndTime": 1616444579.9984186, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17471523362735453, "count": 1, "min": 0.17471523362735453, "max": 0.17471523362735453}}} #metrics {"StartTime": 1616444579.998455, "EndTime": 1616444579.9984646, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421186567938918, "count": 1, "min": 0.17421186567938918, "max": 0.17421186567938918}}} #metrics {"StartTime": 1616444579.9984941, "EndTime": 1616444579.998503, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421602888988733, "count": 1, "min": 0.17421602888988733, "max": 0.17421602888988733}}} #metrics {"StartTime": 1616444579.9985363, "EndTime": 1616444579.9985466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17620428605390098, "count": 1, "min": 0.17620428605390098, "max": 0.17620428605390098}}} #metrics {"StartTime": 1616444579.9985757, "EndTime": 1616444579.9985843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742160006027939, "count": 1, "min": 0.1742160006027939, "max": 0.1742160006027939}}} #metrics {"StartTime": 1616444579.9986155, "EndTime": 1616444579.9986215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17620520612883486, "count": 1, "min": 0.17620520612883486, "max": 0.17620520612883486}}} #metrics {"StartTime": 1616444579.9986491, "EndTime": 1616444579.998657, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44876419400331374, "count": 1, "min": 0.44876419400331374, "max": 0.44876419400331374}}} #metrics {"StartTime": 1616444579.9986844, "EndTime": 1616444579.9986928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45025228351825136, "count": 1, "min": 0.45025228351825136, "max": 0.45025228351825136}}} #metrics {"StartTime": 1616444579.9987245, "EndTime": 1616444579.998734, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44907180436942856, "count": 1, "min": 0.44907180436942856, "max": 0.44907180436942856}}} #metrics {"StartTime": 1616444579.9987645, "EndTime": 1616444579.9987736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4502552481139195, "count": 1, "min": 0.4502552481139195, "max": 0.4502552481139195}}} #metrics {"StartTime": 1616444579.9988043, "EndTime": 1616444579.9988134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934689702982594, "count": 1, "min": 0.44934689702982594, "max": 0.44934689702982594}}} #metrics {"StartTime": 1616444579.998844, "EndTime": 1616444579.9988525, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4503599379700043, "count": 1, "min": 0.4503599379700043, "max": 0.4503599379700043}}} #metrics {"StartTime": 1616444579.998885, "EndTime": 1616444579.998894, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934708299377996, "count": 1, "min": 0.44934708299377996, "max": 0.44934708299377996}}} #metrics {"StartTime": 1616444579.9989276, "EndTime": 1616444579.9989364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4503599119837749, "count": 1, "min": 0.4503599119837749, "max": 0.4503599119837749}}} #metrics {"StartTime": 1616444579.9989724, "EndTime": 1616444579.9989812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847793154118437, "count": 1, "min": 0.6847793154118437, "max": 0.6847793154118437}}} #metrics {"StartTime": 1616444579.999021, "EndTime": 1616444579.9990306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856955971683152, "count": 1, "min": 0.6856955971683152, "max": 0.6856955971683152}}} #metrics {"StartTime": 1616444579.9990675, "EndTime": 1616444579.9990773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848261290626871, "count": 1, "min": 0.6848261290626871, "max": 0.6848261290626871}}} #metrics {"StartTime": 1616444579.9991145, "EndTime": 1616444579.999124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857896794997062, "count": 1, "min": 0.6857896794997062, "max": 0.6857896794997062}}} #metrics {"StartTime": 1616444579.9991517, "EndTime": 1616444579.9991603, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848079062193363, "count": 1, "min": 0.6848079062193363, "max": 0.6848079062193363}}} #metrics {"StartTime": 1616444579.999196, "EndTime": 1616444579.9992054, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854200478540745, "count": 1, "min": 0.6854200478540745, "max": 0.6854200478540745}}} #metrics {"StartTime": 1616444579.999242, "EndTime": 1616444579.9992535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174182620479, "count": 1, "min": 0.6848174182620479, "max": 0.6848174182620479}}} #metrics {"StartTime": 1616444579.999286, "EndTime": 1616444579.9992952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854200654489173, "count": 1, "min": 0.6854200654489173, "max": 0.6854200654489173}}} [03/22/2021 20:22:59 INFO 140710537553728] #quality_metric: host=algo-1, epoch=13, validation binary_classification_cross_entropy_objective <loss>=0.15530284362543934 [03/22/2021 20:22:59 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:22:59 INFO 140710537553728] Epoch 13: Loss improved. Updating best model [03/22/2021 20:23:00 INFO 140710537553728] Saving model for epoch: 13 [03/22/2021 20:23:00 INFO 140710537553728] Saved checkpoint to "/tmp/tmpo_jla7p_/mx-mod-0000.params" [03/22/2021 20:23:00 INFO 140710537553728] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs #metrics {"StartTime": 1616444567.7981007, "EndTime": 1616444580.004943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6325454.0, "count": 1, "min": 6325454, "max": 6325454}, "Total Batches Seen": {"sum": 6326.0, "count": 1, "min": 6326, "max": 6326}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:23:00 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=36942.97838143382 records/second [2021-03-22 20:23:11.452] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 31, "duration": 11444, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444591.452141, "EndTime": 1616444591.4523804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1541779572719998, "count": 1, "min": 0.1541779572719998, "max": 0.1541779572719998}}} #metrics {"StartTime": 1616444591.4524565, "EndTime": 1616444591.452472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13945421122233073, "count": 1, "min": 0.13945421122233073, "max": 0.13945421122233073}}} #metrics {"StartTime": 1616444591.4525168, "EndTime": 1616444591.452529, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15394715014987523, "count": 1, "min": 0.15394715014987523, "max": 0.15394715014987523}}} #metrics {"StartTime": 1616444591.452568, "EndTime": 1616444591.4525785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13956278298272026, "count": 1, "min": 0.13956278298272026, "max": 0.13956278298272026}}} #metrics {"StartTime": 1616444591.4526134, "EndTime": 1616444591.4526236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839451789008247, "count": 1, "min": 0.13839451789008247, "max": 0.13839451789008247}}} #metrics {"StartTime": 1616444591.4526613, "EndTime": 1616444591.452672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1407081058078342, "count": 1, "min": 0.1407081058078342, "max": 0.1407081058078342}}} #metrics {"StartTime": 1616444591.4527094, "EndTime": 1616444591.4527194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839344745212132, "count": 1, "min": 0.13839344745212132, "max": 0.13839344745212132}}} #metrics {"StartTime": 1616444591.4527586, "EndTime": 1616444591.4527688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14070810065375433, "count": 1, "min": 0.14070810065375433, "max": 0.14070810065375433}}} #metrics {"StartTime": 1616444591.4528086, "EndTime": 1616444591.4528189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1744675052218967, "count": 1, "min": 0.1744675052218967, "max": 0.1744675052218967}}} #metrics {"StartTime": 1616444591.4528558, "EndTime": 1616444591.4528658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17334780246310763, "count": 1, "min": 0.17334780246310763, "max": 0.17334780246310763}}} #metrics {"StartTime": 1616444591.4529052, "EndTime": 1616444591.4529152, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17367594014485677, "count": 1, "min": 0.17367594014485677, "max": 0.17367594014485677}}} #metrics {"StartTime": 1616444591.452953, "EndTime": 1616444591.4529636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17334801550971138, "count": 1, "min": 0.17334801550971138, "max": 0.17334801550971138}}} #metrics {"StartTime": 1616444591.4530034, "EndTime": 1616444591.453014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321284233940973, "count": 1, "min": 0.17321284233940973, "max": 0.17321284233940973}}} #metrics {"StartTime": 1616444591.4530518, "EndTime": 1616444591.453063, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496245483398437, "count": 1, "min": 0.17496245483398437, "max": 0.17496245483398437}}} #metrics {"StartTime": 1616444591.4530988, "EndTime": 1616444591.4531095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321285434299044, "count": 1, "min": 0.17321285434299044, "max": 0.17321285434299044}}} #metrics {"StartTime": 1616444591.453143, "EndTime": 1616444591.4531534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.174962642449273, "count": 1, "min": 0.174962642449273, "max": 0.174962642449273}}} #metrics {"StartTime": 1616444591.4531944, "EndTime": 1616444591.4532056, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476731930202908, "count": 1, "min": 0.4476731930202908, "max": 0.4476731930202908}}} #metrics {"StartTime": 1616444591.4532428, "EndTime": 1616444591.453254, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477570364040799, "count": 1, "min": 0.4477570364040799, "max": 0.4477570364040799}}} #metrics {"StartTime": 1616444591.4532912, "EndTime": 1616444591.4533026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767955898708767, "count": 1, "min": 0.44767955898708767, "max": 0.44767955898708767}}} #metrics {"StartTime": 1616444591.4533436, "EndTime": 1616444591.4533553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775703586154514, "count": 1, "min": 0.44775703586154514, "max": 0.44775703586154514}}} #metrics {"StartTime": 1616444591.4533858, "EndTime": 1616444591.453396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768162638346354, "count": 1, "min": 0.44768162638346354, "max": 0.44768162638346354}}} #metrics {"StartTime": 1616444591.4534283, "EndTime": 1616444591.4534383, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485684993489583, "count": 1, "min": 0.4485684993489583, "max": 0.4485684993489583}}} #metrics {"StartTime": 1616444591.4534755, "EndTime": 1616444591.453486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476816246880425, "count": 1, "min": 0.4476816246880425, "max": 0.4476816246880425}}} #metrics {"StartTime": 1616444591.45352, "EndTime": 1616444591.453531, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485684982638889, "count": 1, "min": 0.4485684982638889, "max": 0.4485684982638889}}} #metrics {"StartTime": 1616444591.4535687, "EndTime": 1616444591.453579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847277456325955, "count": 1, "min": 0.6847277456325955, "max": 0.6847277456325955}}} #metrics {"StartTime": 1616444591.4536202, "EndTime": 1616444591.4536314, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848239314778646, "count": 1, "min": 0.6848239314778646, "max": 0.6848239314778646}}} #metrics {"StartTime": 1616444591.45367, "EndTime": 1616444591.4536817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684732181532118, "count": 1, "min": 0.684732181532118, "max": 0.684732181532118}}} #metrics {"StartTime": 1616444591.4537199, "EndTime": 1616444591.4537303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848236692979601, "count": 1, "min": 0.6848236692979601, "max": 0.6848236692979601}}} #metrics {"StartTime": 1616444591.4537704, "EndTime": 1616444591.4537807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847329018825955, "count": 1, "min": 0.6847329018825955, "max": 0.6847329018825955}}} #metrics {"StartTime": 1616444591.4538198, "EndTime": 1616444591.4538305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036924913194, "count": 1, "min": 0.6861036924913194, "max": 0.6861036924913194}}} #metrics {"StartTime": 1616444591.4538696, "EndTime": 1616444591.4538808, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847330346679688, "count": 1, "min": 0.6847330346679688, "max": 0.6847330346679688}}} #metrics {"StartTime": 1616444591.4539204, "EndTime": 1616444591.4539313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036965603299, "count": 1, "min": 0.6861036965603299, "max": 0.6861036965603299}}} [03/22/2021 20:23:11 INFO 140710537553728] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.1541779572719998 [2021-03-22 20:23:12.551] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 44, "duration": 1083, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444593.2214403, "EndTime": 1616444593.2215068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15524713185655326, "count": 1, "min": 0.15524713185655326, "max": 0.15524713185655326}}} #metrics {"StartTime": 1616444593.2215805, "EndTime": 1616444593.2215912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14095786126640772, "count": 1, "min": 0.14095786126640772, "max": 0.14095786126640772}}} #metrics {"StartTime": 1616444593.221623, "EndTime": 1616444593.2216308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15477083973244232, "count": 1, "min": 0.15477083973244232, "max": 0.15477083973244232}}} #metrics {"StartTime": 1616444593.2216609, "EndTime": 1616444593.221669, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410500243388107, "count": 1, "min": 0.1410500243388107, "max": 0.1410500243388107}}} #metrics {"StartTime": 1616444593.221704, "EndTime": 1616444593.2217133, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010144393241467, "count": 1, "min": 0.14010144393241467, "max": 0.14010144393241467}}} #metrics {"StartTime": 1616444593.2218063, "EndTime": 1616444593.2218163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14104525647477223, "count": 1, "min": 0.14104525647477223, "max": 0.14104525647477223}}} #metrics {"StartTime": 1616444593.2218409, "EndTime": 1616444593.2218468, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401005091725543, "count": 1, "min": 0.1401005091725543, "max": 0.1401005091725543}}} #metrics {"StartTime": 1616444593.2218735, "EndTime": 1616444593.2218792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14104530634938434, "count": 1, "min": 0.14104530634938434, "max": 0.14104530634938434}}} #metrics {"StartTime": 1616444593.221909, "EndTime": 1616444593.221917, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1754188616097724, "count": 1, "min": 0.1754188616097724, "max": 0.1754188616097724}}} #metrics {"StartTime": 1616444593.2219446, "EndTime": 1616444593.221953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421152176788476, "count": 1, "min": 0.17421152176788476, "max": 0.17421152176788476}}} #metrics {"StartTime": 1616444593.2219856, "EndTime": 1616444593.2219934, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1746087326528926, "count": 1, "min": 0.1746087326528926, "max": 0.1746087326528926}}} #metrics {"StartTime": 1616444593.222027, "EndTime": 1616444593.2220352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421424544955139, "count": 1, "min": 0.17421424544955139, "max": 0.17421424544955139}}} #metrics {"StartTime": 1616444593.2220705, "EndTime": 1616444593.2220795, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420219135808884, "count": 1, "min": 0.17420219135808884, "max": 0.17420219135808884}}} #metrics {"StartTime": 1616444593.2221138, "EndTime": 1616444593.2221222, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17576303135234245, "count": 1, "min": 0.17576303135234245, "max": 0.17576303135234245}}} #metrics {"StartTime": 1616444593.2221553, "EndTime": 1616444593.222163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420216740203365, "count": 1, "min": 0.17420216740203365, "max": 0.17420216740203365}}} #metrics {"StartTime": 1616444593.2221968, "EndTime": 1616444593.2222059, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17576321907578069, "count": 1, "min": 0.17576321907578069, "max": 0.17576321907578069}}} #metrics {"StartTime": 1616444593.2222395, "EndTime": 1616444593.2222486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487645123346236, "count": 1, "min": 0.4487645123346236, "max": 0.4487645123346236}}} #metrics {"StartTime": 1616444593.2222822, "EndTime": 1616444593.222291, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45038041159978504, "count": 1, "min": 0.45038041159978504, "max": 0.45038041159978504}}} #metrics {"StartTime": 1616444593.2223244, "EndTime": 1616444593.2223337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44907412309902073, "count": 1, "min": 0.44907412309902073, "max": 0.44907412309902073}}} #metrics {"StartTime": 1616444593.2223601, "EndTime": 1616444593.2223659, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45038217135475567, "count": 1, "min": 0.45038217135475567, "max": 0.45038217135475567}}} #metrics {"StartTime": 1616444593.2223847, "EndTime": 1616444593.2223895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912069096344465, "count": 1, "min": 0.44912069096344465, "max": 0.44912069096344465}}} #metrics {"StartTime": 1616444593.2224076, "EndTime": 1616444593.2224123, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970885948951267, "count": 1, "min": 0.44970885948951267, "max": 0.44970885948951267}}} #metrics {"StartTime": 1616444593.2224305, "EndTime": 1616444593.2224352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4491207778548991, "count": 1, "min": 0.4491207778548991, "max": 0.4491207778548991}}} #metrics {"StartTime": 1616444593.2224529, "EndTime": 1616444593.222458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970885245157555, "count": 1, "min": 0.44970885245157555, "max": 0.44970885245157555}}} #metrics {"StartTime": 1616444593.2224755, "EndTime": 1616444593.2224803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847818136088324, "count": 1, "min": 0.6847818136088324, "max": 0.6847818136088324}}} #metrics {"StartTime": 1616444593.2224975, "EndTime": 1616444593.2225025, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856624877344998, "count": 1, "min": 0.6856624877344998, "max": 0.6856624877344998}}} #metrics {"StartTime": 1616444593.2225199, "EndTime": 1616444593.2225246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848271482101205, "count": 1, "min": 0.6848271482101205, "max": 0.6848271482101205}}} #metrics {"StartTime": 1616444593.222542, "EndTime": 1616444593.2225466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857717519790246, "count": 1, "min": 0.6857717519790246, "max": 0.6857717519790246}}} #metrics {"StartTime": 1616444593.222566, "EndTime": 1616444593.2225704, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174615724302, "count": 1, "min": 0.6848174615724302, "max": 0.6848174615724302}}} #metrics {"StartTime": 1616444593.2225878, "EndTime": 1616444593.2225928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247523274133, "count": 1, "min": 0.6855247523274133, "max": 0.6855247523274133}}} #metrics {"StartTime": 1616444593.22261, "EndTime": 1616444593.2226148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848125983578782, "count": 1, "min": 0.6848125983578782, "max": 0.6848125983578782}}} #metrics {"StartTime": 1616444593.2226322, "EndTime": 1616444593.2226367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247504325841, "count": 1, "min": 0.6855247504325841, "max": 0.6855247504325841}}} [03/22/2021 20:23:13 INFO 140710537553728] #quality_metric: host=algo-1, epoch=14, validation binary_classification_cross_entropy_objective <loss>=0.15524713185655326 [03/22/2021 20:23:13 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:23:13 INFO 140710537553728] Epoch 14: Loss improved. Updating best model [03/22/2021 20:23:13 INFO 140710537553728] Saving model for epoch: 14 [03/22/2021 20:23:13 INFO 140710537553728] Saved checkpoint to "/tmp/tmp8j18b6p_/mx-mod-0000.params" [03/22/2021 20:23:13 INFO 140710537553728] #progress_metric: host=algo-1, completed 100.0 % of epochs #metrics {"StartTime": 1616444580.0078478, "EndTime": 1616444593.2279105, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6776415.0, "count": 1, "min": 6776415, "max": 6776415}, "Total Batches Seen": {"sum": 6777.0, "count": 1, "min": 6777, "max": 6777}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:23:13 INFO 140710537553728] #throughput_metric: host=algo-1, train throughput=34111.59098658006 records/second [03/22/2021 20:23:13 WARNING 140710537553728] wait_for_all_workers will not sync workers since the kv store is not running distributed [03/22/2021 20:23:13 WARNING 140710537553728] wait_for_all_workers will not sync workers since the kv store is not running distributed [2021-03-22 20:23:14.226] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 47, "duration": 984, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:23:14 INFO 140710537553728] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:23:14 INFO 140710537553728] Epoch 14: Loss improved. Updating best model [2021-03-22 20:23:15.060] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 49, "duration": 121, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.14010144393241467) [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('binary_classification_accuracy', 0.9505765478091184) [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('binary_f_1.000', 0.9500591546266088) [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('precision', 0.9693112403526098) [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('recall', 0.9315569304320315) [03/22/2021 20:23:15 INFO 140710537553728] #validation_score (algo-1) : ('roc_auc_score', 0.9841679686506282) [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation binary_classification_cross_entropy_objective <loss>=0.14010144393241467 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation binary_classification_accuracy <score>=0.9505765478091184 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation binary_f_1.000 <score>=0.9500591546266088 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation precision <score>=0.9693112403526098 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation recall <score>=0.9315569304320315 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, validation roc_auc_score <score>=0.9841679686506282 [03/22/2021 20:23:15 INFO 140710537553728] Best model found for hyperparameters: {"optimizer": "adam", "learning_rate": 0.1, "wd": 0.0001, "l1": 0.0, "lr_scheduler_step": 10, "lr_scheduler_factor": 0.99, "lr_scheduler_minimum_lr": 1e-05} [03/22/2021 20:23:15 INFO 140710537553728] Saved checkpoint to "/tmp/tmp22sl1496/mx-mod-0000.params" [2021-03-22 20:23:15.084] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 0, "duration": 189703, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:23:15.205] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 1, "duration": 120, "num_examples": 57, "num_bytes": 8117424} #metrics {"StartTime": 1616444595.0842962, "EndTime": 1616444595.224453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "test_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Total Batches Seen": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Max Records Seen Between Resets": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Max Batches Seen Between Resets": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Reset Count": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Number of Records Since Last Reset": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Number of Batches Since Last Reset": {"sum": 57.0, "count": 1, "min": 57, "max": 57}}} [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.14020745600416684) [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('binary_classification_accuracy', 0.9501694133508364) [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('binary_f_1.000', 0.9494465940790066) [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('precision', 0.9702074444607915) [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('recall', 0.9295556260351693) [03/22/2021 20:23:15 INFO 140710537553728] #test_score (algo-1) : ('roc_auc_score', 0.9838786783455571) [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test binary_classification_cross_entropy_objective <loss>=0.14020745600416684 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test binary_classification_accuracy <score>=0.9501694133508364 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test binary_f_1.000 <score>=0.9494465940790066 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test precision <score>=0.9702074444607915 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test recall <score>=0.9295556260351693 [03/22/2021 20:23:15 INFO 140710537553728] #quality_metric: host=algo-1, test roc_auc_score <score>=0.9838786783455571 #metrics {"StartTime": 1616444405.3736959, "EndTime": 1616444595.2283816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training"}, "Metrics": {"initialize.time": {"sum": 238.36350440979004, "count": 1, "min": 238.36350440979004, "max": 238.36350440979004}, "epochs": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "check_early_stopping.time": {"sum": 12.695789337158203, "count": 16, "min": 0.6687641143798828, "max": 1.1439323425292969}, "update.time": {"sum": 187528.4321308136, "count": 15, "min": 11608.167171478271, "max": 13365.313529968262}, "finalize.time": {"sum": 1853.8248538970947, "count": 1, "min": 1853.8248538970947, "max": 1853.8248538970947}, "setuptime": {"sum": 41.99028015136719, "count": 1, "min": 41.99028015136719, "max": 41.99028015136719}, "totaltime": {"sum": 190240.980386734, "count": 1, "min": 190240.980386734, "max": 190240.980386734}}} 2021-03-22 20:23:38 Uploading - Uploading generated training model 2021-03-22 20:23:38 Completed - Training job completed ProfilerReport-1616444224: NoIssuesFound Training seconds: 244 Billable seconds: 244
Standerscaling don't affect the recall 0.929.
from sklearn.preprocessing import MinMaxScaler
scaler = MinMaxScaler()
scaler.fit(train_features)
train_features_scaled = scaler.transform(train_features)
val_features_scaled = scaler.transform(val_features)
test_features_scaled = scaler.transform(test_features)
linear_estimator_smote_min = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
train_instance_count=1,
train_instance_type='ml.m5.xlarge',
predictor_type='binary_classifier')
train_records_smote = linear_estimator_smote_min.record_set(train_features_scaled, train_labels, channel='train')
val_records_smote = linear_estimator_smote_min.record_set(val_features_scaled, val_labels, channel='validation')
test_records_smote = linear_estimator_smote_min.record_set(test_features_scaled, test_labels, channel='test')
linear_estimator_smote_min.fit([train_records_smote, val_records_smote, test_records_smote])
train_instance_count has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. train_instance_type has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
2021-03-22 20:24:02 Starting - Starting the training job... 2021-03-22 20:24:04 Starting - Launching requested ML instancesProfilerReport-1616444642: InProgress ...... 2021-03-22 20:25:32 Starting - Preparing the instances for training...... 2021-03-22 20:26:31 Downloading - Downloading input data... 2021-03-22 20:26:53 Training - Training image download completed. Training in progress.Docker entrypoint called with argument(s): train Running default environment configuration script [03/22/2021 20:26:56 INFO 139804890085184] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'} [03/22/2021 20:26:56 INFO 139804890085184] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'feature_dim': '25', 'predictor_type': 'binary_classifier', 'mini_batch_size': '1000'} [03/22/2021 20:26:56 INFO 139804890085184] Final configuration: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': '25', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'} [03/22/2021 20:26:56 WARNING 139804890085184] Loggers have already been setup. Process 1 is a worker. [03/22/2021 20:26:56 INFO 139804890085184] Using default worker. [03/22/2021 20:26:56 INFO 139804890085184] Checkpoint loading and saving are disabled. [2021-03-22 20:26:56.993] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:26:56.998] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:26:57.025] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 0, "duration": 34, "num_examples": 1, "num_bytes": 144000} [03/22/2021 20:26:57 INFO 139804890085184] Create Store: local [2021-03-22 20:26:57.097] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 1, "duration": 71, "num_examples": 11, "num_bytes": 1584000} [03/22/2021 20:26:57 INFO 139804890085184] Scaler algorithm parameters <algorithm.scaler.ScalerAlgorithmStable object at 0x7f2677fe7990> [03/22/2021 20:26:57 INFO 139804890085184] Scaling model computed with parameters: {'stdev_label': None, 'stdev_weight': [0.08655601 0.03573724 0.10146225 0.13728553 0.0260946 0.01591559 0.03824606 0.07439721 0.08725227 0.16639861 0.0753182 0.06852172 0.10668758 0.09295297 0.00981602 0.02712389 0.04095646 0.01337871 0.07338788 0.03459588 0.07190529 0.01595108 0.00793295 0.0094923 0.26856223] <NDArray 25 @cpu(0)>, 'mean_label': None, 'mean_weight': [0.92260444 0.7850167 0.78004545 0.34982577 0.7559225 0.25562003 0.7912938 0.4191924 0.45205453 0.38478127 0.44388774 0.3344992 0.3857595 0.5885253 0.5825778 0.5652768 0.5118609 0.6649587 0.37384474 0.57914186 0.43112552 0.41886532 0.3140902 0.00409899 0.5570435 ] <NDArray 25 @cpu(0)>} [03/22/2021 20:26:57 INFO 139804890085184] nvidia-smi took: 0.025209426879882812 secs to identify 0 gpus [03/22/2021 20:26:57 INFO 139804890085184] Number of GPUs being used: 0 #metrics {"StartTime": 1616444817.2029257, "EndTime": 1616444817.2029586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "init_train_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12000.0, "count": 1, "min": 12000, "max": 12000}, "Total Batches Seen": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Max Records Seen Between Resets": {"sum": 11000.0, "count": 1, "min": 11000, "max": 11000}, "Max Batches Seen Between Resets": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Reset Count": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Number of Records Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}, "Number of Batches Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}}} [2021-03-22 20:27:08.406] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 3, "duration": 11203, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444828.4064314, "EndTime": 1616444828.406515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26976728827582463, "count": 1, "min": 0.26976728827582463, "max": 0.26976728827582463}}} #metrics {"StartTime": 1616444828.4066014, "EndTime": 1616444828.4066172, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2619445831637912, "count": 1, "min": 0.2619445831637912, "max": 0.2619445831637912}}} #metrics {"StartTime": 1616444828.4066627, "EndTime": 1616444828.4066737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2808347368028429, "count": 1, "min": 0.2808347368028429, "max": 0.2808347368028429}}} #metrics {"StartTime": 1616444828.4067109, "EndTime": 1616444828.4067209, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26674125851101343, "count": 1, "min": 0.26674125851101343, "max": 0.26674125851101343}}} #metrics {"StartTime": 1616444828.4067602, "EndTime": 1616444828.4067702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15496321912977432, "count": 1, "min": 0.15496321912977432, "max": 0.15496321912977432}}} #metrics {"StartTime": 1616444828.40682, "EndTime": 1616444828.40683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1545701534186469, "count": 1, "min": 0.1545701534186469, "max": 0.1545701534186469}}} #metrics {"StartTime": 1616444828.406865, "EndTime": 1616444828.4068747, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15427642454359267, "count": 1, "min": 0.15427642454359267, "max": 0.15427642454359267}}} #metrics {"StartTime": 1616444828.406909, "EndTime": 1616444828.4069178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1546575363328722, "count": 1, "min": 0.1546575363328722, "max": 0.1546575363328722}}} #metrics {"StartTime": 1616444828.4069514, "EndTime": 1616444828.4069607, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2755368968370226, "count": 1, "min": 0.2755368968370226, "max": 0.2755368968370226}}} #metrics {"StartTime": 1616444828.4069936, "EndTime": 1616444828.4070039, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.27247168867323135, "count": 1, "min": 0.27247168867323135, "max": 0.27247168867323135}}} #metrics {"StartTime": 1616444828.4070356, "EndTime": 1616444828.4070444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2665694243706597, "count": 1, "min": 0.2665694243706597, "max": 0.2665694243706597}}} #metrics {"StartTime": 1616444828.407079, "EndTime": 1616444828.4070888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2678597599283854, "count": 1, "min": 0.2678597599283854, "max": 0.2678597599283854}}} #metrics {"StartTime": 1616444828.4071238, "EndTime": 1616444828.4071329, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17992738223605687, "count": 1, "min": 0.17992738223605687, "max": 0.17992738223605687}}} #metrics {"StartTime": 1616444828.4071672, "EndTime": 1616444828.4071763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18042501739501954, "count": 1, "min": 0.18042501739501954, "max": 0.18042501739501954}}} #metrics {"StartTime": 1616444828.4072118, "EndTime": 1616444828.4072216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1803544620429145, "count": 1, "min": 0.1803544620429145, "max": 0.1803544620429145}}} #metrics {"StartTime": 1616444828.407253, "EndTime": 1616444828.4072616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1795898063490126, "count": 1, "min": 0.1795898063490126, "max": 0.1795898063490126}}} #metrics {"StartTime": 1616444828.4072948, "EndTime": 1616444828.4073043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4553869405110677, "count": 1, "min": 0.4553869405110677, "max": 0.4553869405110677}}} #metrics {"StartTime": 1616444828.4073384, "EndTime": 1616444828.407347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45205988952636716, "count": 1, "min": 0.45205988952636716, "max": 0.45205988952636716}}} #metrics {"StartTime": 1616444828.4073787, "EndTime": 1616444828.4073875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45405638014051647, "count": 1, "min": 0.45405638014051647, "max": 0.45405638014051647}}} #metrics {"StartTime": 1616444828.40742, "EndTime": 1616444828.4074275, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45335088236490884, "count": 1, "min": 0.45335088236490884, "max": 0.45335088236490884}}} #metrics {"StartTime": 1616444828.4074605, "EndTime": 1616444828.4074693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4496841853162977, "count": 1, "min": 0.4496841853162977, "max": 0.4496841853162977}}} #metrics {"StartTime": 1616444828.407504, "EndTime": 1616444828.4075139, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.45004119439019097, "count": 1, "min": 0.45004119439019097, "max": 0.45004119439019097}}} #metrics {"StartTime": 1616444828.4075494, "EndTime": 1616444828.4075584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44963837707519533, "count": 1, "min": 0.44963837707519533, "max": 0.44963837707519533}}} #metrics {"StartTime": 1616444828.4075942, "EndTime": 1616444828.4076033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4500798779296875, "count": 1, "min": 0.4500798779296875, "max": 0.4500798779296875}}} #metrics {"StartTime": 1616444828.4076376, "EndTime": 1616444828.4076467, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6843651298014323, "count": 1, "min": 0.6843651298014323, "max": 0.6843651298014323}}} #metrics {"StartTime": 1616444828.4076815, "EndTime": 1616444828.4076908, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854449146864149, "count": 1, "min": 0.6854449146864149, "max": 0.6854449146864149}}} #metrics {"StartTime": 1616444828.407725, "EndTime": 1616444828.407735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847846472167969, "count": 1, "min": 0.6847846472167969, "max": 0.6847846472167969}}} #metrics {"StartTime": 1616444828.4077687, "EndTime": 1616444828.4077768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848822812228733, "count": 1, "min": 0.6848822812228733, "max": 0.6848822812228733}}} #metrics {"StartTime": 1616444828.4078102, "EndTime": 1616444828.407819, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6870081065538195, "count": 1, "min": 0.6870081065538195, "max": 0.6870081065538195}}} #metrics {"StartTime": 1616444828.4078536, "EndTime": 1616444828.4078624, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872150040690104, "count": 1, "min": 0.6872150040690104, "max": 0.6872150040690104}}} #metrics {"StartTime": 1616444828.4078944, "EndTime": 1616444828.4079027, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6871324644639757, "count": 1, "min": 0.6871324644639757, "max": 0.6871324644639757}}} #metrics {"StartTime": 1616444828.4079359, "EndTime": 1616444828.407944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6872138524034288, "count": 1, "min": 0.6872138524034288, "max": 0.6872138524034288}}} [03/22/2021 20:27:08 INFO 139804890085184] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.26976728827582463 [2021-03-22 20:27:08.423] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 0, "duration": 11429, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:27:09.375] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 2, "duration": 952, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444830.3115826, "EndTime": 1616444830.3116465, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20004103198549691, "count": 1, "min": 0.20004103198549691, "max": 0.20004103198549691}}} #metrics {"StartTime": 1616444830.31172, "EndTime": 1616444830.3117328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19091413551047695, "count": 1, "min": 0.19091413551047695, "max": 0.19091413551047695}}} #metrics {"StartTime": 1616444830.3117654, "EndTime": 1616444830.3117745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20627407921910687, "count": 1, "min": 0.20627407921910687, "max": 0.20627407921910687}}} #metrics {"StartTime": 1616444830.3118181, "EndTime": 1616444830.3118272, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19310116878696973, "count": 1, "min": 0.19310116878696973, "max": 0.19310116878696973}}} #metrics {"StartTime": 1616444830.3118684, "EndTime": 1616444830.3118804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14326623771468525, "count": 1, "min": 0.14326623771468525, "max": 0.14326623771468525}}} #metrics {"StartTime": 1616444830.3119159, "EndTime": 1616444830.3119261, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14325360712143087, "count": 1, "min": 0.14325360712143087, "max": 0.14325360712143087}}} #metrics {"StartTime": 1616444830.3119612, "EndTime": 1616444830.3119705, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14311493864629588, "count": 1, "min": 0.14311493864629588, "max": 0.14311493864629588}}} #metrics {"StartTime": 1616444830.3120008, "EndTime": 1616444830.3120098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1434227133211735, "count": 1, "min": 0.1434227133211735, "max": 0.1434227133211735}}} #metrics {"StartTime": 1616444830.3120432, "EndTime": 1616444830.3120522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20897230953956214, "count": 1, "min": 0.20897230953956214, "max": 0.20897230953956214}}} #metrics {"StartTime": 1616444830.3120818, "EndTime": 1616444830.3120904, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20238040844895472, "count": 1, "min": 0.20238040844895472, "max": 0.20238040844895472}}} #metrics {"StartTime": 1616444830.312125, "EndTime": 1616444830.3121352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20547102244162108, "count": 1, "min": 0.20547102244162108, "max": 0.20547102244162108}}} #metrics {"StartTime": 1616444830.312164, "EndTime": 1616444830.3121722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.20001878506625104, "count": 1, "min": 0.20001878506625104, "max": 0.20001878506625104}}} #metrics {"StartTime": 1616444830.312206, "EndTime": 1616444830.312215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17538608877883433, "count": 1, "min": 0.17538608877883433, "max": 0.17538608877883433}}} #metrics {"StartTime": 1616444830.3122532, "EndTime": 1616444830.3122635, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17505503720968185, "count": 1, "min": 0.17505503720968185, "max": 0.17505503720968185}}} #metrics {"StartTime": 1616444830.312297, "EndTime": 1616444830.312307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17531859969889757, "count": 1, "min": 0.17531859969889757, "max": 0.17531859969889757}}} #metrics {"StartTime": 1616444830.3123367, "EndTime": 1616444830.3123462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.175075639552505, "count": 1, "min": 0.175075639552505, "max": 0.175075639552505}}} #metrics {"StartTime": 1616444830.3123834, "EndTime": 1616444830.3123937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496440693231176, "count": 1, "min": 0.4496440693231176, "max": 0.4496440693231176}}} #metrics {"StartTime": 1616444830.3124254, "EndTime": 1616444830.312437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498555279336374, "count": 1, "min": 0.4498555279336374, "max": 0.4498555279336374}}} #metrics {"StartTime": 1616444830.3124723, "EndTime": 1616444830.3124826, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496778963558298, "count": 1, "min": 0.4496778963558298, "max": 0.4496778963558298}}} #metrics {"StartTime": 1616444830.312515, "EndTime": 1616444830.3125246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499536438150695, "count": 1, "min": 0.4499536438150695, "max": 0.4499536438150695}}} #metrics {"StartTime": 1616444830.312559, "EndTime": 1616444830.3125691, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44930022386703505, "count": 1, "min": 0.44930022386703505, "max": 0.44930022386703505}}} #metrics {"StartTime": 1616444830.3126016, "EndTime": 1616444830.312609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44834764773950986, "count": 1, "min": 0.44834764773950986, "max": 0.44834764773950986}}} #metrics {"StartTime": 1616444830.3126414, "EndTime": 1616444830.31265, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44928896479177755, "count": 1, "min": 0.44928896479177755, "max": 0.44928896479177755}}} #metrics {"StartTime": 1616444830.3126829, "EndTime": 1616444830.312692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45016613754372614, "count": 1, "min": 0.45016613754372614, "max": 0.45016613754372614}}} #metrics {"StartTime": 1616444830.3127315, "EndTime": 1616444830.3127413, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847923791765934, "count": 1, "min": 0.6847923791765934, "max": 0.6847923791765934}}} #metrics {"StartTime": 1616444830.3127768, "EndTime": 1616444830.3127863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845544598173203, "count": 1, "min": 0.6845544598173203, "max": 0.6845544598173203}}} #metrics {"StartTime": 1616444830.312823, "EndTime": 1616444830.3128333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847500784675852, "count": 1, "min": 0.6847500784675852, "max": 0.6847500784675852}}} #metrics {"StartTime": 1616444830.3128715, "EndTime": 1616444830.3128812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845814267561667, "count": 1, "min": 0.6845814267561667, "max": 0.6845814267561667}}} #metrics {"StartTime": 1616444830.3129168, "EndTime": 1616444830.3129246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849995730679065, "count": 1, "min": 0.6849995730679065, "max": 0.6849995730679065}}} #metrics {"StartTime": 1616444830.3129575, "EndTime": 1616444830.312967, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867463081255648, "count": 1, "min": 0.6867463081255648, "max": 0.6867463081255648}}} #metrics {"StartTime": 1616444830.3130016, "EndTime": 1616444830.3130112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851805990969265, "count": 1, "min": 0.6851805990969265, "max": 0.6851805990969265}}} #metrics {"StartTime": 1616444830.3130436, "EndTime": 1616444830.313053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6867069998932832, "count": 1, "min": 0.6867069998932832, "max": 0.6867069998932832}}} [03/22/2021 20:27:10 INFO 139804890085184] #quality_metric: host=algo-1, epoch=0, validation binary_classification_cross_entropy_objective <loss>=0.20004103198549691 [03/22/2021 20:27:10 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=sampled_accuracy, value=0.9500266098988824 [03/22/2021 20:27:10 INFO 139804890085184] Epoch 0: Loss improved. Updating best model [03/22/2021 20:27:10 INFO 139804890085184] Saving model for epoch: 0 [03/22/2021 20:27:10 INFO 139804890085184] Saved checkpoint to "/tmp/tmp_ze6_nfq/mx-mod-0000.params" [03/22/2021 20:27:10 INFO 139804890085184] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs #metrics {"StartTime": 1616444817.203218, "EndTime": 1616444830.3212628, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 462961.0, "count": 1, "min": 462961, "max": 462961}, "Total Batches Seen": {"sum": 463.0, "count": 1, "min": 463, "max": 463}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:27:10 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=34376.86167840116 records/second [2021-03-22 20:27:20.750] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 5, "duration": 10426, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444840.7501333, "EndTime": 1616444840.7502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18476642951117622, "count": 1, "min": 0.18476642951117622, "max": 0.18476642951117622}}} #metrics {"StartTime": 1616444840.7502704, "EndTime": 1616444840.7502813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17468984941270616, "count": 1, "min": 0.17468984941270616, "max": 0.17468984941270616}}} #metrics {"StartTime": 1616444840.7503107, "EndTime": 1616444840.7503173, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18961667914496527, "count": 1, "min": 0.18961667914496527, "max": 0.18961667914496527}}} #metrics {"StartTime": 1616444840.750343, "EndTime": 1616444840.7503495, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17632025370279947, "count": 1, "min": 0.17632025370279947, "max": 0.17632025370279947}}} #metrics {"StartTime": 1616444840.750374, "EndTime": 1616444840.7503803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14118830115424263, "count": 1, "min": 0.14118830115424263, "max": 0.14118830115424263}}} #metrics {"StartTime": 1616444840.7504041, "EndTime": 1616444840.75041, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14225948203192817, "count": 1, "min": 0.14225948203192817, "max": 0.14225948203192817}}} #metrics {"StartTime": 1616444840.7504342, "EndTime": 1616444840.7504401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14105197143554687, "count": 1, "min": 0.14105197143554687, "max": 0.14105197143554687}}} #metrics {"StartTime": 1616444840.750466, "EndTime": 1616444840.7504723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14231038770887586, "count": 1, "min": 0.14231038770887586, "max": 0.14231038770887586}}} #metrics {"StartTime": 1616444840.750496, "EndTime": 1616444840.7505019, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1955727993774414, "count": 1, "min": 0.1955727993774414, "max": 0.1955727993774414}}} #metrics {"StartTime": 1616444840.7505255, "EndTime": 1616444840.7505314, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18844150516086156, "count": 1, "min": 0.18844150516086156, "max": 0.18844150516086156}}} #metrics {"StartTime": 1616444840.7505548, "EndTime": 1616444840.7505608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19316921213785807, "count": 1, "min": 0.19316921213785807, "max": 0.19316921213785807}}} #metrics {"StartTime": 1616444840.7505846, "EndTime": 1616444840.7505906, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18693647091335722, "count": 1, "min": 0.18693647091335722, "max": 0.18693647091335722}}} #metrics {"StartTime": 1616444840.750614, "EndTime": 1616444840.75062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17476415496826173, "count": 1, "min": 0.17476415496826173, "max": 0.17476415496826173}}} #metrics {"StartTime": 1616444840.7506435, "EndTime": 1616444840.7506495, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17543563734266493, "count": 1, "min": 0.17543563734266493, "max": 0.17543563734266493}}} #metrics {"StartTime": 1616444840.7506728, "EndTime": 1616444840.7506785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1747487766181098, "count": 1, "min": 0.1747487766181098, "max": 0.1747487766181098}}} #metrics {"StartTime": 1616444840.750702, "EndTime": 1616444840.7507076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17550794677734374, "count": 1, "min": 0.17550794677734374, "max": 0.17550794677734374}}} #metrics {"StartTime": 1616444840.7507312, "EndTime": 1616444840.750737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447749760945638, "count": 1, "min": 0.447749760945638, "max": 0.447749760945638}}} #metrics {"StartTime": 1616444840.7507598, "EndTime": 1616444840.7507658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478319795735677, "count": 1, "min": 0.4478319795735677, "max": 0.4478319795735677}}} #metrics {"StartTime": 1616444840.7507892, "EndTime": 1616444840.7507951, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477498555501302, "count": 1, "min": 0.4477498555501302, "max": 0.4477498555501302}}} #metrics {"StartTime": 1616444840.7508204, "EndTime": 1616444840.7508264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478314218478733, "count": 1, "min": 0.4478314218478733, "max": 0.4478314218478733}}} #metrics {"StartTime": 1616444840.7508497, "EndTime": 1616444840.7508557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44839983086480034, "count": 1, "min": 0.44839983086480034, "max": 0.44839983086480034}}} #metrics {"StartTime": 1616444840.7508793, "EndTime": 1616444840.750885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4492029493543837, "count": 1, "min": 0.4492029493543837, "max": 0.4492029493543837}}} #metrics {"StartTime": 1616444840.7509084, "EndTime": 1616444840.7509143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448390030992296, "count": 1, "min": 0.448390030992296, "max": 0.448390030992296}}} #metrics {"StartTime": 1616444840.7509377, "EndTime": 1616444840.7509434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4492053963216146, "count": 1, "min": 0.4492053963216146, "max": 0.4492053963216146}}} #metrics {"StartTime": 1616444840.7509665, "EndTime": 1616444840.7509727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848157297092013, "count": 1, "min": 0.6848157297092013, "max": 0.6848157297092013}}} #metrics {"StartTime": 1616444840.7509959, "EndTime": 1616444840.7510018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848825741916232, "count": 1, "min": 0.6848825741916232, "max": 0.6848825741916232}}} #metrics {"StartTime": 1616444840.751025, "EndTime": 1616444840.7510307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848149879286024, "count": 1, "min": 0.6848149879286024, "max": 0.6848149879286024}}} #metrics {"StartTime": 1616444840.7510543, "EndTime": 1616444840.75106, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848844300672743, "count": 1, "min": 0.6848844300672743, "max": 0.6848844300672743}}} #metrics {"StartTime": 1616444840.751083, "EndTime": 1616444840.7510889, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6859979907226562, "count": 1, "min": 0.6859979907226562, "max": 0.6859979907226562}}} #metrics {"StartTime": 1616444840.7511125, "EndTime": 1616444840.7511182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686455644124349, "count": 1, "min": 0.686455644124349, "max": 0.686455644124349}}} #metrics {"StartTime": 1616444840.751141, "EndTime": 1616444840.751147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686006793891059, "count": 1, "min": 0.686006793891059, "max": 0.686006793891059}}} #metrics {"StartTime": 1616444840.7511697, "EndTime": 1616444840.7511754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864578937445747, "count": 1, "min": 0.6864578937445747, "max": 0.6864578937445747}}} [03/22/2021 20:27:20 INFO 139804890085184] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.18476642951117622 [2021-03-22 20:27:21.785] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 5, "duration": 1020, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444842.441424, "EndTime": 1616444842.4414864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1756618385389381, "count": 1, "min": 0.1756618385389381, "max": 0.1756618385389381}}} #metrics {"StartTime": 1616444842.4415631, "EndTime": 1616444842.4415743, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16489431270581092, "count": 1, "min": 0.16489431270581092, "max": 0.16489431270581092}}} #metrics {"StartTime": 1616444842.441606, "EndTime": 1616444842.4416146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.179443479290621, "count": 1, "min": 0.179443479290621, "max": 0.179443479290621}}} #metrics {"StartTime": 1616444842.4416463, "EndTime": 1616444842.4416542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16605123736787736, "count": 1, "min": 0.16605123736787736, "max": 0.16605123736787736}}} #metrics {"StartTime": 1616444842.4416902, "EndTime": 1616444842.4416995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14130965553109096, "count": 1, "min": 0.14130965553109096, "max": 0.14130965553109096}}} #metrics {"StartTime": 1616444842.4417343, "EndTime": 1616444842.4417446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14276511879366552, "count": 1, "min": 0.14276511879366552, "max": 0.14276511879366552}}} #metrics {"StartTime": 1616444842.4417794, "EndTime": 1616444842.441789, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14127465586977817, "count": 1, "min": 0.14127465586977817, "max": 0.14127465586977817}}} #metrics {"StartTime": 1616444842.4418302, "EndTime": 1616444842.4418404, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14278477751153443, "count": 1, "min": 0.14278477751153443, "max": 0.14278477751153443}}} #metrics {"StartTime": 1616444842.4418762, "EndTime": 1616444842.4418864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1882291335342242, "count": 1, "min": 0.1882291335342242, "max": 0.1882291335342242}}} #metrics {"StartTime": 1616444842.4419222, "EndTime": 1616444842.4419315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18106209601158155, "count": 1, "min": 0.18106209601158155, "max": 0.18106209601158155}}} #metrics {"StartTime": 1616444842.4419653, "EndTime": 1616444842.4419746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18652091209867733, "count": 1, "min": 0.18652091209867733, "max": 0.18652091209867733}}} #metrics {"StartTime": 1616444842.4420135, "EndTime": 1616444842.4420228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18021380979582965, "count": 1, "min": 0.18021380979582965, "max": 0.18021380979582965}}} #metrics {"StartTime": 1616444842.4420626, "EndTime": 1616444842.4420724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421879141555308, "count": 1, "min": 0.17421879141555308, "max": 0.17421879141555308}}} #metrics {"StartTime": 1616444842.4421046, "EndTime": 1616444842.4421115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751643604646026, "count": 1, "min": 0.1751643604646026, "max": 0.1751643604646026}}} #metrics {"StartTime": 1616444842.442135, "EndTime": 1616444842.4421418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17432521795029546, "count": 1, "min": 0.17432521795029546, "max": 0.17432521795029546}}} #metrics {"StartTime": 1616444842.4421747, "EndTime": 1616444842.4421833, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17530787320599733, "count": 1, "min": 0.17530787320599733, "max": 0.17530787320599733}}} #metrics {"StartTime": 1616444842.4422193, "EndTime": 1616444842.4422288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496007611063412, "count": 1, "min": 0.4496007611063412, "max": 0.4496007611063412}}} #metrics {"StartTime": 1616444842.442267, "EndTime": 1616444842.4422784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44982443053776944, "count": 1, "min": 0.44982443053776944, "max": 0.44982443053776944}}} #metrics {"StartTime": 1616444842.4423196, "EndTime": 1616444842.4423301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496404431613599, "count": 1, "min": 0.4496404431613599, "max": 0.4496404431613599}}} #metrics {"StartTime": 1616444842.442369, "EndTime": 1616444842.4423792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499649462007093, "count": 1, "min": 0.4499649462007093, "max": 0.4499649462007093}}} #metrics {"StartTime": 1616444842.4424179, "EndTime": 1616444842.442428, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45594721603461225, "count": 1, "min": 0.45594721603461225, "max": 0.45594721603461225}}} #metrics {"StartTime": 1616444842.4424655, "EndTime": 1616444842.442475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4489326648938861, "count": 1, "min": 0.4489326648938861, "max": 0.4489326648938861}}} #metrics {"StartTime": 1616444842.4425092, "EndTime": 1616444842.442518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4559789094896166, "count": 1, "min": 0.4559789094896166, "max": 0.4559789094896166}}} #metrics {"StartTime": 1616444842.4425502, "EndTime": 1616444842.4425583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44921323983661243, "count": 1, "min": 0.44921323983661243, "max": 0.44921323983661243}}} #metrics {"StartTime": 1616444842.4425917, "EndTime": 1616444842.4426005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847396728775488, "count": 1, "min": 0.6847396728775488, "max": 0.6847396728775488}}} #metrics {"StartTime": 1616444842.4426372, "EndTime": 1616444842.442647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845663100792961, "count": 1, "min": 0.6845663100792961, "max": 0.6845663100792961}}} #metrics {"StartTime": 1616444842.4426854, "EndTime": 1616444842.4426954, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497409172931, "count": 1, "min": 0.6847497409172931, "max": 0.6847497409172931}}} #metrics {"StartTime": 1616444842.44273, "EndTime": 1616444842.4427397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847265785248414, "count": 1, "min": 0.6847265785248414, "max": 0.6847265785248414}}} #metrics {"StartTime": 1616444842.442771, "EndTime": 1616444842.4427786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853497039432197, "count": 1, "min": 0.6853497039432197, "max": 0.6853497039432197}}} #metrics {"StartTime": 1616444842.4428046, "EndTime": 1616444842.4428103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6874107389262282, "count": 1, "min": 0.6874107389262282, "max": 0.6874107389262282}}} #metrics {"StartTime": 1616444842.442841, "EndTime": 1616444842.4428504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855064932116173, "count": 1, "min": 0.6855064932116173, "max": 0.6855064932116173}}} #metrics {"StartTime": 1616444842.4428895, "EndTime": 1616444842.4429002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6877234025311973, "count": 1, "min": 0.6877234025311973, "max": 0.6877234025311973}}} [03/22/2021 20:27:22 INFO 139804890085184] #quality_metric: host=algo-1, epoch=1, validation binary_classification_cross_entropy_objective <loss>=0.1756618385389381 [03/22/2021 20:27:22 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=sampled_accuracy, value=0.9505233280113536 [03/22/2021 20:27:22 INFO 139804890085184] Epoch 1: Loss improved. Updating best model [03/22/2021 20:27:22 INFO 139804890085184] Saving model for epoch: 1 [03/22/2021 20:27:22 INFO 139804890085184] Saved checkpoint to "/tmp/tmprgpzjs0o/mx-mod-0000.params" [03/22/2021 20:27:22 INFO 139804890085184] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs #metrics {"StartTime": 1616444830.3239698, "EndTime": 1616444842.448689, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 913922.0, "count": 1, "min": 913922, "max": 913922}, "Total Batches Seen": {"sum": 914.0, "count": 1, "min": 914, "max": 914}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:27:22 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=37193.14759978951 records/second [2021-03-22 20:27:33.067] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 7, "duration": 10616, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444853.0677032, "EndTime": 1616444853.0677793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16985383293999565, "count": 1, "min": 0.16985383293999565, "max": 0.16985383293999565}}} #metrics {"StartTime": 1616444853.067854, "EndTime": 1616444853.067869, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15863513861762152, "count": 1, "min": 0.15863513861762152, "max": 0.15863513861762152}}} #metrics {"StartTime": 1616444853.067912, "EndTime": 1616444853.0679228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17320562459309896, "count": 1, "min": 0.17320562459309896, "max": 0.17320562459309896}}} #metrics {"StartTime": 1616444853.0679624, "EndTime": 1616444853.0679736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1597026035563151, "count": 1, "min": 0.1597026035563151, "max": 0.1597026035563151}}} #metrics {"StartTime": 1616444853.0680146, "EndTime": 1616444853.0680263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13983879318237305, "count": 1, "min": 0.13983879318237305, "max": 0.13983879318237305}}} #metrics {"StartTime": 1616444853.0680602, "EndTime": 1616444853.06807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1420042727830675, "count": 1, "min": 0.1420042727830675, "max": 0.1420042727830675}}} #metrics {"StartTime": 1616444853.0681155, "EndTime": 1616444853.0681257, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1397996686469184, "count": 1, "min": 0.1397996686469184, "max": 0.1397996686469184}}} #metrics {"StartTime": 1616444853.0681584, "EndTime": 1616444853.0681682, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14200192445543078, "count": 1, "min": 0.14200192445543078, "max": 0.14200192445543078}}} #metrics {"StartTime": 1616444853.0682003, "EndTime": 1616444853.06821, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18366793233235676, "count": 1, "min": 0.18366793233235676, "max": 0.18366793233235676}}} #metrics {"StartTime": 1616444853.0682478, "EndTime": 1616444853.0682576, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1771691197713216, "count": 1, "min": 0.1771691197713216, "max": 0.1771691197713216}}} #metrics {"StartTime": 1616444853.0682912, "EndTime": 1616444853.0683012, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18230988410101998, "count": 1, "min": 0.18230988410101998, "max": 0.18230988410101998}}} #metrics {"StartTime": 1616444853.0683393, "EndTime": 1616444853.0683491, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1766287890625, "count": 1, "min": 0.1766287890625, "max": 0.1766287890625}}} #metrics {"StartTime": 1616444853.0683856, "EndTime": 1616444853.0683959, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17428289238823785, "count": 1, "min": 0.17428289238823785, "max": 0.17428289238823785}}} #metrics {"StartTime": 1616444853.0684304, "EndTime": 1616444853.0684407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17545226993136936, "count": 1, "min": 0.17545226993136936, "max": 0.17545226993136936}}} #metrics {"StartTime": 1616444853.0684774, "EndTime": 1616444853.0684884, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17427346269395616, "count": 1, "min": 0.17427346269395616, "max": 0.17427346269395616}}} #metrics {"StartTime": 1616444853.0685234, "EndTime": 1616444853.0685332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17549752888997397, "count": 1, "min": 0.17549752888997397, "max": 0.17549752888997397}}} #metrics {"StartTime": 1616444853.0685678, "EndTime": 1616444853.0685778, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477293401421441, "count": 1, "min": 0.4477293401421441, "max": 0.4477293401421441}}} #metrics {"StartTime": 1616444853.068607, "EndTime": 1616444853.0686135, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478246228027344, "count": 1, "min": 0.4478246228027344, "max": 0.4478246228027344}}} #metrics {"StartTime": 1616444853.0686445, "EndTime": 1616444853.068653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477288380262587, "count": 1, "min": 0.4477288380262587, "max": 0.4477288380262587}}} #metrics {"StartTime": 1616444853.068689, "EndTime": 1616444853.0686991, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478236819797092, "count": 1, "min": 0.4478236819797092, "max": 0.4478236819797092}}} #metrics {"StartTime": 1616444853.0687268, "EndTime": 1616444853.0687346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833697496202257, "count": 1, "min": 0.44833697496202257, "max": 0.44833697496202257}}} #metrics {"StartTime": 1616444853.0687673, "EndTime": 1616444853.0687761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4491620311821832, "count": 1, "min": 0.4491620311821832, "max": 0.4491620311821832}}} #metrics {"StartTime": 1616444853.068808, "EndTime": 1616444853.0688167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44833108859592014, "count": 1, "min": 0.44833108859592014, "max": 0.44833108859592014}}} #metrics {"StartTime": 1616444853.068848, "EndTime": 1616444853.0688715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4491599180094401, "count": 1, "min": 0.4491599180094401, "max": 0.4491599180094401}}} #metrics {"StartTime": 1616444853.068906, "EndTime": 1616444853.0689147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847873418511284, "count": 1, "min": 0.6847873418511284, "max": 0.6847873418511284}}} #metrics {"StartTime": 1616444853.068948, "EndTime": 1616444853.0689566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848740996636284, "count": 1, "min": 0.6848740996636284, "max": 0.6848740996636284}}} #metrics {"StartTime": 1616444853.0689893, "EndTime": 1616444853.0689983, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847866171603733, "count": 1, "min": 0.6847866171603733, "max": 0.6847866171603733}}} #metrics {"StartTime": 1616444853.0690331, "EndTime": 1616444853.0690417, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848765078396267, "count": 1, "min": 0.6848765078396267, "max": 0.6848765078396267}}} #metrics {"StartTime": 1616444853.0690782, "EndTime": 1616444853.069088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685466305609809, "count": 1, "min": 0.685466305609809, "max": 0.685466305609809}}} #metrics {"StartTime": 1616444853.0691283, "EndTime": 1616444853.0691388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864741783311632, "count": 1, "min": 0.6864741783311632, "max": 0.6864741783311632}}} #metrics {"StartTime": 1616444853.069175, "EndTime": 1616444853.069184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6854679018825954, "count": 1, "min": 0.6854679018825954, "max": 0.6854679018825954}}} #metrics {"StartTime": 1616444853.0692163, "EndTime": 1616444853.0692253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.68647244140625, "count": 1, "min": 0.68647244140625, "max": 0.68647244140625}}} [03/22/2021 20:27:33 INFO 139804890085184] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.16985383293999565 [2021-03-22 20:27:34.040] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 8, "duration": 956, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444854.7133832, "EndTime": 1616444854.7134442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16682747899587216, "count": 1, "min": 0.16682747899587216, "max": 0.16682747899587216}}} #metrics {"StartTime": 1616444854.7135134, "EndTime": 1616444854.7135246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15537686025671277, "count": 1, "min": 0.15537686025671277, "max": 0.15537686025671277}}} #metrics {"StartTime": 1616444854.7135575, "EndTime": 1616444854.7135649, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16974685693307404, "count": 1, "min": 0.16974685693307404, "max": 0.16974685693307404}}} #metrics {"StartTime": 1616444854.7135954, "EndTime": 1616444854.7136037, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1562514978625027, "count": 1, "min": 0.1562514978625027, "max": 0.1562514978625027}}} #metrics {"StartTime": 1616444854.7136385, "EndTime": 1616444854.7136483, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14105252016726297, "count": 1, "min": 0.14105252016726297, "max": 0.14105252016726297}}} #metrics {"StartTime": 1616444854.713674, "EndTime": 1616444854.7136817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14302827105235394, "count": 1, "min": 0.14302827105235394, "max": 0.14302827105235394}}} #metrics {"StartTime": 1616444854.7137113, "EndTime": 1616444854.7137194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101078168115486, "count": 1, "min": 0.14101078168115486, "max": 0.14101078168115486}}} #metrics {"StartTime": 1616444854.7137506, "EndTime": 1616444854.7137585, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1430205337202293, "count": 1, "min": 0.1430205337202293, "max": 0.1430205337202293}}} #metrics {"StartTime": 1616444854.7137887, "EndTime": 1616444854.7137973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18182365481092594, "count": 1, "min": 0.18182365481092594, "max": 0.18182365481092594}}} #metrics {"StartTime": 1616444854.71383, "EndTime": 1616444854.7138398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17588854984799787, "count": 1, "min": 0.17588854984799787, "max": 0.17588854984799787}}} #metrics {"StartTime": 1616444854.713874, "EndTime": 1616444854.713884, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1807451599727439, "count": 1, "min": 0.1807451599727439, "max": 0.1807451599727439}}} #metrics {"StartTime": 1616444854.7139213, "EndTime": 1616444854.7139325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17560231410296057, "count": 1, "min": 0.17560231410296057, "max": 0.17560231410296057}}} #metrics {"StartTime": 1616444854.7139642, "EndTime": 1616444854.7139738, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743324764320058, "count": 1, "min": 0.1743324764320058, "max": 0.1743324764320058}}} #metrics {"StartTime": 1616444854.714003, "EndTime": 1616444854.7140126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17515934891199123, "count": 1, "min": 0.17515934891199123, "max": 0.17515934891199123}}} #metrics {"StartTime": 1616444854.7140498, "EndTime": 1616444854.7140596, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743420326648419, "count": 1, "min": 0.1743420326648419, "max": 0.1743420326648419}}} #metrics {"StartTime": 1616444854.7140965, "EndTime": 1616444854.7141051, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751812401447225, "count": 1, "min": 0.1751812401447225, "max": 0.1751812401447225}}} #metrics {"StartTime": 1616444854.7141416, "EndTime": 1616444854.7141507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493836077219293, "count": 1, "min": 0.4493836077219293, "max": 0.4493836077219293}}} #metrics {"StartTime": 1616444854.7141843, "EndTime": 1616444854.7141905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44985095056760854, "count": 1, "min": 0.44985095056760854, "max": 0.44985095056760854}}} #metrics {"StartTime": 1616444854.7142224, "EndTime": 1616444854.714231, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493866833004521, "count": 1, "min": 0.4493866833004521, "max": 0.4493866833004521}}} #metrics {"StartTime": 1616444854.7142656, "EndTime": 1616444854.7142751, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498561970790439, "count": 1, "min": 0.4498561970790439, "max": 0.4498561970790439}}} #metrics {"StartTime": 1616444854.714309, "EndTime": 1616444854.7143178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4557540492933651, "count": 1, "min": 0.4557540492933651, "max": 0.4557540492933651}}} #metrics {"StartTime": 1616444854.7143507, "EndTime": 1616444854.7143595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934562722355503, "count": 1, "min": 0.44934562722355503, "max": 0.44934562722355503}}} #metrics {"StartTime": 1616444854.7143967, "EndTime": 1616444854.714407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45601391294058785, "count": 1, "min": 0.45601391294058785, "max": 0.45601391294058785}}} #metrics {"StartTime": 1616444854.714443, "EndTime": 1616444854.7144537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44944971641877535, "count": 1, "min": 0.44944971641877535, "max": 0.44944971641877535}}} #metrics {"StartTime": 1616444854.714491, "EndTime": 1616444854.7145004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846063797622364, "count": 1, "min": 0.6846063797622364, "max": 0.6846063797622364}}} #metrics {"StartTime": 1616444854.7145374, "EndTime": 1616444854.7145472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846835539910691, "count": 1, "min": 0.6846835539910691, "max": 0.6846835539910691}}} #metrics {"StartTime": 1616444854.7145784, "EndTime": 1616444854.7145848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847082409089775, "count": 1, "min": 0.6847082409089775, "max": 0.6847082409089775}}} #metrics {"StartTime": 1616444854.7146106, "EndTime": 1616444854.714619, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845976324184622, "count": 1, "min": 0.6845976324184622, "max": 0.6845976324184622}}} #metrics {"StartTime": 1616444854.7146504, "EndTime": 1616444854.7146592, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6881677107500527, "count": 1, "min": 0.6881677107500527, "max": 0.6881677107500527}}} #metrics {"StartTime": 1616444854.714688, "EndTime": 1616444854.7146971, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6878732567246298, "count": 1, "min": 0.6878732567246298, "max": 0.6878732567246298}}} #metrics {"StartTime": 1616444854.7147229, "EndTime": 1616444854.7147315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6883786637118592, "count": 1, "min": 0.6883786637118592, "max": 0.6883786637118592}}} #metrics {"StartTime": 1616444854.714756, "EndTime": 1616444854.7147648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6890521071323884, "count": 1, "min": 0.6890521071323884, "max": 0.6890521071323884}}} [03/22/2021 20:27:34 INFO 139804890085184] #quality_metric: host=algo-1, epoch=2, validation binary_classification_cross_entropy_objective <loss>=0.16682747899587216 [03/22/2021 20:27:34 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:27:34 INFO 139804890085184] Epoch 2: Loss improved. Updating best model [03/22/2021 20:27:34 INFO 139804890085184] Saving model for epoch: 2 [03/22/2021 20:27:34 INFO 139804890085184] Saved checkpoint to "/tmp/tmpdvta9lh2/mx-mod-0000.params" [03/22/2021 20:27:34 INFO 139804890085184] #progress_metric: host=algo-1, completed 20.0 % of epochs #metrics {"StartTime": 1616444842.4512503, "EndTime": 1616444854.7208664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1364883.0, "count": 1, "min": 1364883, "max": 1364883}, "Total Batches Seen": {"sum": 1365.0, "count": 1, "min": 1365, "max": 1365}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:27:34 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=36753.924802530004 records/second [2021-03-22 20:27:45.060] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 9, "duration": 10336, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444865.060884, "EndTime": 1616444865.060969, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16351998850504557, "count": 1, "min": 0.16351998850504557, "max": 0.16351998850504557}}} #metrics {"StartTime": 1616444865.0610585, "EndTime": 1616444865.0610766, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1517308379787869, "count": 1, "min": 0.1517308379787869, "max": 0.1517308379787869}}} #metrics {"StartTime": 1616444865.0611181, "EndTime": 1616444865.0611298, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16620085842556423, "count": 1, "min": 0.16620085842556423, "max": 0.16620085842556423}}} #metrics {"StartTime": 1616444865.0611653, "EndTime": 1616444865.061177, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15253453589545357, "count": 1, "min": 0.15253453589545357, "max": 0.15253453589545357}}} #metrics {"StartTime": 1616444865.0612202, "EndTime": 1616444865.0612316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13938124888102213, "count": 1, "min": 0.13938124888102213, "max": 0.13938124888102213}}} #metrics {"StartTime": 1616444865.0612793, "EndTime": 1616444865.0612895, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14196454228719074, "count": 1, "min": 0.14196454228719074, "max": 0.14196454228719074}}} #metrics {"StartTime": 1616444865.0613227, "EndTime": 1616444865.0613317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13936803142971463, "count": 1, "min": 0.13936803142971463, "max": 0.13936803142971463}}} #metrics {"StartTime": 1616444865.0613668, "EndTime": 1616444865.0613768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14195914496527778, "count": 1, "min": 0.14195914496527778, "max": 0.14195914496527778}}} #metrics {"StartTime": 1616444865.061411, "EndTime": 1616444865.0614202, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17933889068603515, "count": 1, "min": 0.17933889068603515, "max": 0.17933889068603515}}} #metrics {"StartTime": 1616444865.0614557, "EndTime": 1616444865.0614712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17430108696831598, "count": 1, "min": 0.17430108696831598, "max": 0.17430108696831598}}} #metrics {"StartTime": 1616444865.0615096, "EndTime": 1616444865.06152, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17841957387288412, "count": 1, "min": 0.17841957387288412, "max": 0.17841957387288412}}} #metrics {"StartTime": 1616444865.0615487, "EndTime": 1616444865.0615578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1741219048055013, "count": 1, "min": 0.1741219048055013, "max": 0.1741219048055013}}} #metrics {"StartTime": 1616444865.061589, "EndTime": 1616444865.061598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17391994869656033, "count": 1, "min": 0.17391994869656033, "max": 0.17391994869656033}}} #metrics {"StartTime": 1616444865.061631, "EndTime": 1616444865.0616405, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17542519070095486, "count": 1, "min": 0.17542519070095486, "max": 0.17542519070095486}}} #metrics {"StartTime": 1616444865.061675, "EndTime": 1616444865.0616844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17391513997395833, "count": 1, "min": 0.17391513997395833, "max": 0.17391513997395833}}} #metrics {"StartTime": 1616444865.061718, "EndTime": 1616444865.061728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17545422400580513, "count": 1, "min": 0.17545422400580513, "max": 0.17545422400580513}}} #metrics {"StartTime": 1616444865.0617623, "EndTime": 1616444865.061772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477140665690104, "count": 1, "min": 0.4477140665690104, "max": 0.4477140665690104}}} #metrics {"StartTime": 1616444865.061801, "EndTime": 1616444865.0618088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478183272298177, "count": 1, "min": 0.4478183272298177, "max": 0.4478183272298177}}} #metrics {"StartTime": 1616444865.061841, "EndTime": 1616444865.0618498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44771498040093316, "count": 1, "min": 0.44771498040093316, "max": 0.44771498040093316}}} #metrics {"StartTime": 1616444865.061888, "EndTime": 1616444865.0618982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44781643391927084, "count": 1, "min": 0.44781643391927084, "max": 0.44781643391927084}}} #metrics {"StartTime": 1616444865.0619256, "EndTime": 1616444865.0619347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4481405028618707, "count": 1, "min": 0.4481405028618707, "max": 0.4481405028618707}}} #metrics {"StartTime": 1616444865.0619652, "EndTime": 1616444865.061974, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490838669840495, "count": 1, "min": 0.4490838669840495, "max": 0.4490838669840495}}} #metrics {"StartTime": 1616444865.0620072, "EndTime": 1616444865.062016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44813781833224825, "count": 1, "min": 0.44813781833224825, "max": 0.44813781833224825}}} #metrics {"StartTime": 1616444865.0620503, "EndTime": 1616444865.06206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490834427218967, "count": 1, "min": 0.4490834427218967, "max": 0.4490834427218967}}} #metrics {"StartTime": 1616444865.062087, "EndTime": 1616444865.0620964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847693446180556, "count": 1, "min": 0.6847693446180556, "max": 0.6847693446180556}}} #metrics {"StartTime": 1616444865.062127, "EndTime": 1616444865.0621362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848677709960937, "count": 1, "min": 0.6848677709960937, "max": 0.6848677709960937}}} #metrics {"StartTime": 1616444865.0621705, "EndTime": 1616444865.0621803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684768942328559, "count": 1, "min": 0.684768942328559, "max": 0.684768942328559}}} #metrics {"StartTime": 1616444865.062213, "EndTime": 1616444865.0622218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694722493489, "count": 1, "min": 0.6848694722493489, "max": 0.6848694722493489}}} #metrics {"StartTime": 1616444865.0622568, "EndTime": 1616444865.0622663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6852227699110243, "count": 1, "min": 0.6852227699110243, "max": 0.6852227699110243}}} #metrics {"StartTime": 1616444865.0622988, "EndTime": 1616444865.0623085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865127465820312, "count": 1, "min": 0.6865127465820312, "max": 0.6865127465820312}}} #metrics {"StartTime": 1616444865.0623434, "EndTime": 1616444865.0623534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685223202718099, "count": 1, "min": 0.685223202718099, "max": 0.685223202718099}}} #metrics {"StartTime": 1616444865.062388, "EndTime": 1616444865.0623984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865094048394097, "count": 1, "min": 0.6865094048394097, "max": 0.6865094048394097}}} [03/22/2021 20:27:45 INFO 139804890085184] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.16351998850504557 [2021-03-22 20:27:46.071] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 11, "duration": 994, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444866.7292562, "EndTime": 1616444866.7293196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16250318453120322, "count": 1, "min": 0.16250318453120322, "max": 0.16250318453120322}}} #metrics {"StartTime": 1616444866.72939, "EndTime": 1616444866.7294014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15066524848714669, "count": 1, "min": 0.15066524848714669, "max": 0.15066524848714669}}} #metrics {"StartTime": 1616444866.7294338, "EndTime": 1616444866.7294421, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1648866003448286, "count": 1, "min": 0.1648866003448286, "max": 0.1648866003448286}}} #metrics {"StartTime": 1616444866.7294738, "EndTime": 1616444866.7294824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1513382330883135, "count": 1, "min": 0.1513382330883135, "max": 0.1513382330883135}}} #metrics {"StartTime": 1616444866.729519, "EndTime": 1616444866.7295284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144502389043997, "count": 1, "min": 0.14144502389043997, "max": 0.14144502389043997}}} #metrics {"StartTime": 1616444866.729561, "EndTime": 1616444866.7295704, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1430545566647489, "count": 1, "min": 0.1430545566647489, "max": 0.1430545566647489}}} #metrics {"StartTime": 1616444866.7296002, "EndTime": 1616444866.7296088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414434491520087, "count": 1, "min": 0.1414434491520087, "max": 0.1414434491520087}}} #metrics {"StartTime": 1616444866.729642, "EndTime": 1616444866.7296507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1430453370347902, "count": 1, "min": 0.1430453370347902, "max": 0.1430453370347902}}} #metrics {"StartTime": 1616444866.7296839, "EndTime": 1616444866.7296934, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1790615569705635, "count": 1, "min": 0.1790615569705635, "max": 0.1790615569705635}}} #metrics {"StartTime": 1616444866.729721, "EndTime": 1616444866.7297273, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1745387799566004, "count": 1, "min": 0.1745387799566004, "max": 0.1745387799566004}}} #metrics {"StartTime": 1616444866.7297554, "EndTime": 1616444866.7297645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.178288674536423, "count": 1, "min": 0.178288674536423, "max": 0.178288674536423}}} #metrics {"StartTime": 1616444866.7297964, "EndTime": 1616444866.7298048, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17445727177962186, "count": 1, "min": 0.17445727177962186, "max": 0.17445727177962186}}} #metrics {"StartTime": 1616444866.7298362, "EndTime": 1616444866.7298453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427006590042804, "count": 1, "min": 0.17427006590042804, "max": 0.17427006590042804}}} #metrics {"StartTime": 1616444866.7298865, "EndTime": 1616444866.729898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.175056761504277, "count": 1, "min": 0.175056761504277, "max": 0.175056761504277}}} #metrics {"StartTime": 1616444866.7299376, "EndTime": 1616444866.7299478, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742819286141388, "count": 1, "min": 0.1742819286141388, "max": 0.1742819286141388}}} #metrics {"StartTime": 1616444866.7299852, "EndTime": 1616444866.7299953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17501216290879804, "count": 1, "min": 0.17501216290879804, "max": 0.17501216290879804}}} #metrics {"StartTime": 1616444866.7300303, "EndTime": 1616444866.7300396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44946436263661826, "count": 1, "min": 0.44946436263661826, "max": 0.44946436263661826}}} #metrics {"StartTime": 1616444866.7300687, "EndTime": 1616444866.730075, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44978540463504246, "count": 1, "min": 0.44978540463504246, "max": 0.44978540463504246}}} #metrics {"StartTime": 1616444866.7300951, "EndTime": 1616444866.7301002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494527061886032, "count": 1, "min": 0.4494527061886032, "max": 0.4494527061886032}}} #metrics {"StartTime": 1616444866.7301197, "EndTime": 1616444866.7301254, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44975240510132203, "count": 1, "min": 0.44975240510132203, "max": 0.44975240510132203}}} #metrics {"StartTime": 1616444866.7301586, "EndTime": 1616444866.730168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44167462873907193, "count": 1, "min": 0.44167462873907193, "max": 0.44167462873907193}}} #metrics {"StartTime": 1616444866.730204, "EndTime": 1616444866.7302139, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44947023335893843, "count": 1, "min": 0.44947023335893843, "max": 0.44947023335893843}}} #metrics {"StartTime": 1616444866.7302485, "EndTime": 1616444866.730258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44170052618216554, "count": 1, "min": 0.44170052618216554, "max": 0.44170052618216554}}} #metrics {"StartTime": 1616444866.7302883, "EndTime": 1616444866.7302957, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4495302431418876, "count": 1, "min": 0.4495302431418876, "max": 0.4495302431418876}}} #metrics {"StartTime": 1616444866.7303183, "EndTime": 1616444866.730324, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845725589553917, "count": 1, "min": 0.6845725589553917, "max": 0.6845725589553917}}} #metrics {"StartTime": 1616444866.7303472, "EndTime": 1616444866.7303553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846288066902587, "count": 1, "min": 0.6846288066902587, "max": 0.6846288066902587}}} #metrics {"StartTime": 1616444866.7303922, "EndTime": 1616444866.7304022, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846486474470782, "count": 1, "min": 0.6846486474470782, "max": 0.6846486474470782}}} #metrics {"StartTime": 1616444866.7304423, "EndTime": 1616444866.7304523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846265174658644, "count": 1, "min": 0.6846265174658644, "max": 0.6846265174658644}}} #metrics {"StartTime": 1616444866.7304902, "EndTime": 1616444866.7304995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6859786965649496, "count": 1, "min": 0.6859786965649496, "max": 0.6859786965649496}}} #metrics {"StartTime": 1616444866.730528, "EndTime": 1616444866.730537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858252938977577, "count": 1, "min": 0.6858252938977577, "max": 0.6858252938977577}}} #metrics {"StartTime": 1616444866.7305667, "EndTime": 1616444866.730577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858306643851624, "count": 1, "min": 0.6858306643851624, "max": 0.6858306643851624}}} #metrics {"StartTime": 1616444866.7306118, "EndTime": 1616444866.7306228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6870177329379615, "count": 1, "min": 0.6870177329379615, "max": 0.6870177329379615}}} [03/22/2021 20:27:46 INFO 139804890085184] #quality_metric: host=algo-1, epoch=3, validation binary_classification_cross_entropy_objective <loss>=0.16250318453120322 [03/22/2021 20:27:46 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:27:46 INFO 139804890085184] Epoch 3: Loss improved. Updating best model [03/22/2021 20:27:46 INFO 139804890085184] Saving model for epoch: 3 [03/22/2021 20:27:46 INFO 139804890085184] Saved checkpoint to "/tmp/tmp3l05xlao/mx-mod-0000.params" [03/22/2021 20:27:46 INFO 139804890085184] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs #metrics {"StartTime": 1616444854.72417, "EndTime": 1616444866.7362683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1815844.0, "count": 1, "min": 1815844, "max": 1815844}, "Total Batches Seen": {"sum": 1816.0, "count": 1, "min": 1816, "max": 1816}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:27:46 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=37541.8549973106 records/second [2021-03-22 20:27:57.435] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 11, "duration": 10696, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444877.4352314, "EndTime": 1616444877.4353018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16011860426161023, "count": 1, "min": 0.16011860426161023, "max": 0.16011860426161023}}} #metrics {"StartTime": 1616444877.4354224, "EndTime": 1616444877.4354403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1480200862121582, "count": 1, "min": 0.1480200862121582, "max": 0.1480200862121582}}} #metrics {"StartTime": 1616444877.4354832, "EndTime": 1616444877.4354916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16250615095350476, "count": 1, "min": 0.16250615095350476, "max": 0.16250615095350476}}} #metrics {"StartTime": 1616444877.4355156, "EndTime": 1616444877.4355214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14865621234469945, "count": 1, "min": 0.14865621234469945, "max": 0.14865621234469945}}} #metrics {"StartTime": 1616444877.4355524, "EndTime": 1616444877.4355612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13909911024305555, "count": 1, "min": 0.13909911024305555, "max": 0.13909911024305555}}} #metrics {"StartTime": 1616444877.435602, "EndTime": 1616444877.4356127, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14186613106621637, "count": 1, "min": 0.14186613106621637, "max": 0.14186613106621637}}} #metrics {"StartTime": 1616444877.4356523, "EndTime": 1616444877.4356627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13909598541259766, "count": 1, "min": 0.13909598541259766, "max": 0.13909598541259766}}} #metrics {"StartTime": 1616444877.435705, "EndTime": 1616444877.4357145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1418623385450575, "count": 1, "min": 0.1418623385450575, "max": 0.1418623385450575}}} #metrics {"StartTime": 1616444877.4357502, "EndTime": 1616444877.4357593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17732769432915582, "count": 1, "min": 0.17732769432915582, "max": 0.17732769432915582}}} #metrics {"StartTime": 1616444877.4357963, "EndTime": 1616444877.4358063, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357961605495878, "count": 1, "min": 0.17357961605495878, "max": 0.17357961605495878}}} #metrics {"StartTime": 1616444877.4358425, "EndTime": 1616444877.4358518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17663700066460503, "count": 1, "min": 0.17663700066460503, "max": 0.17663700066460503}}} #metrics {"StartTime": 1616444877.435888, "EndTime": 1616444877.4358974, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735298484971788, "count": 1, "min": 0.1735298484971788, "max": 0.1735298484971788}}} #metrics {"StartTime": 1616444877.435931, "EndTime": 1616444877.4359386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737194529554579, "count": 1, "min": 0.1737194529554579, "max": 0.1737194529554579}}} #metrics {"StartTime": 1616444877.4359725, "EndTime": 1616444877.4359813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753838033718533, "count": 1, "min": 0.1753838033718533, "max": 0.1753838033718533}}} #metrics {"StartTime": 1616444877.436015, "EndTime": 1616444877.436023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737181137084961, "count": 1, "min": 0.1737181137084961, "max": 0.1737181137084961}}} #metrics {"StartTime": 1616444877.4360542, "EndTime": 1616444877.4360628, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.175398579305013, "count": 1, "min": 0.175398579305013, "max": 0.175398579305013}}} #metrics {"StartTime": 1616444877.4360955, "EndTime": 1616444877.4361043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476956044514974, "count": 1, "min": 0.4476956044514974, "max": 0.4476956044514974}}} #metrics {"StartTime": 1616444877.4361377, "EndTime": 1616444877.436146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447809974093967, "count": 1, "min": 0.447809974093967, "max": 0.447809974093967}}} #metrics {"StartTime": 1616444877.4361694, "EndTime": 1616444877.436175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476959119330512, "count": 1, "min": 0.4476959119330512, "max": 0.4476959119330512}}} #metrics {"StartTime": 1616444877.4362063, "EndTime": 1616444877.436215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478086589898003, "count": 1, "min": 0.4478086589898003, "max": 0.4478086589898003}}} #metrics {"StartTime": 1616444877.4362447, "EndTime": 1616444877.436251, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4480250968424479, "count": 1, "min": 0.4480250968424479, "max": 0.4480250968424479}}} #metrics {"StartTime": 1616444877.4362724, "EndTime": 1616444877.4362803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4490056199815538, "count": 1, "min": 0.4490056199815538, "max": 0.4490056199815538}}} #metrics {"StartTime": 1616444877.4363132, "EndTime": 1616444877.4363225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4480270204671224, "count": 1, "min": 0.4480270204671224, "max": 0.4480270204671224}}} #metrics {"StartTime": 1616444877.4363594, "EndTime": 1616444877.4363692, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44900588372124567, "count": 1, "min": 0.44900588372124567, "max": 0.44900588372124567}}} #metrics {"StartTime": 1616444877.4364052, "EndTime": 1616444877.436415, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684755149875217, "count": 1, "min": 0.684755149875217, "max": 0.684755149875217}}} #metrics {"StartTime": 1616444877.4364486, "EndTime": 1616444877.4364572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848608025444879, "count": 1, "min": 0.6848608025444879, "max": 0.6848608025444879}}} #metrics {"StartTime": 1616444877.4364908, "EndTime": 1616444877.4364989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684755344780816, "count": 1, "min": 0.684755344780816, "max": 0.684755344780816}}} #metrics {"StartTime": 1616444877.4365299, "EndTime": 1616444877.4365387, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848622871907553, "count": 1, "min": 0.6848622871907553, "max": 0.6848622871907553}}} #metrics {"StartTime": 1616444877.436571, "EndTime": 1616444877.436577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851455611165365, "count": 1, "min": 0.6851455611165365, "max": 0.6851455611165365}}} #metrics {"StartTime": 1616444877.4365993, "EndTime": 1616444877.4366076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865761569552952, "count": 1, "min": 0.6865761569552952, "max": 0.6865761569552952}}} #metrics {"StartTime": 1616444877.4366405, "EndTime": 1616444877.4366488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6851455798339844, "count": 1, "min": 0.6851455798339844, "max": 0.6851455798339844}}} #metrics {"StartTime": 1616444877.436671, "EndTime": 1616444877.4366765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865822191026476, "count": 1, "min": 0.6865822191026476, "max": 0.6865822191026476}}} [03/22/2021 20:27:57 INFO 139804890085184] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.16011860426161023 [2021-03-22 20:27:58.512] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 14, "duration": 1061, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444879.1743727, "EndTime": 1616444879.1744337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1599324948952218, "count": 1, "min": 0.1599324948952218, "max": 0.1599324948952218}}} #metrics {"StartTime": 1616444879.1745012, "EndTime": 1616444879.1745117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14792190343326597, "count": 1, "min": 0.14792190343326597, "max": 0.14792190343326597}}} #metrics {"StartTime": 1616444879.174537, "EndTime": 1616444879.1745446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16214592963938215, "count": 1, "min": 0.16214592963938215, "max": 0.16214592963938215}}} #metrics {"StartTime": 1616444879.1745777, "EndTime": 1616444879.1745856, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14846924623953275, "count": 1, "min": 0.14846924623953275, "max": 0.14846924623953275}}} #metrics {"StartTime": 1616444879.1746194, "EndTime": 1616444879.1746283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1406178761188371, "count": 1, "min": 0.1406178761188371, "max": 0.1406178761188371}}} #metrics {"StartTime": 1616444879.1746647, "EndTime": 1616444879.174673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1428617385720792, "count": 1, "min": 0.1428617385720792, "max": 0.1428617385720792}}} #metrics {"StartTime": 1616444879.1747084, "EndTime": 1616444879.1747189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14061600267411292, "count": 1, "min": 0.14061600267411292, "max": 0.14061600267411292}}} #metrics {"StartTime": 1616444879.1747541, "EndTime": 1616444879.1747627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14285469136382747, "count": 1, "min": 0.14285469136382747, "max": 0.14285469136382747}}} #metrics {"StartTime": 1616444879.1747978, "EndTime": 1616444879.1748073, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1776412617384129, "count": 1, "min": 0.1776412617384129, "max": 0.1776412617384129}}} #metrics {"StartTime": 1616444879.1748435, "EndTime": 1616444879.1748528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421707632441416, "count": 1, "min": 0.17421707632441416, "max": 0.17421707632441416}}} #metrics {"StartTime": 1616444879.174888, "EndTime": 1616444879.1748972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17703848922212476, "count": 1, "min": 0.17703848922212476, "max": 0.17703848922212476}}} #metrics {"StartTime": 1616444879.174934, "EndTime": 1616444879.174943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742021651011696, "count": 1, "min": 0.1742021651011696, "max": 0.1742021651011696}}} #metrics {"StartTime": 1616444879.1749792, "EndTime": 1616444879.174989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17477231556078804, "count": 1, "min": 0.17477231556078804, "max": 0.17477231556078804}}} #metrics {"StartTime": 1616444879.1750216, "EndTime": 1616444879.175028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17488470586750002, "count": 1, "min": 0.17488470586750002, "max": 0.17488470586750002}}} #metrics {"StartTime": 1616444879.1750484, "EndTime": 1616444879.1750536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17476032792369334, "count": 1, "min": 0.17476032792369334, "max": 0.17476032792369334}}} #metrics {"StartTime": 1616444879.175073, "EndTime": 1616444879.175078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1748245840189367, "count": 1, "min": 0.1748245840189367, "max": 0.1748245840189367}}} #metrics {"StartTime": 1616444879.1751006, "EndTime": 1616444879.1751082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4496300846713643, "count": 1, "min": 0.4496300846713643, "max": 0.4496300846713643}}} #metrics {"StartTime": 1616444879.1751382, "EndTime": 1616444879.1751475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44973617291141743, "count": 1, "min": 0.44973617291141743, "max": 0.44973617291141743}}} #metrics {"StartTime": 1616444879.1751847, "EndTime": 1616444879.1751943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44964868079607256, "count": 1, "min": 0.44964868079607256, "max": 0.44964868079607256}}} #metrics {"StartTime": 1616444879.1752288, "EndTime": 1616444879.1752377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497250137207291, "count": 1, "min": 0.4497250137207291, "max": 0.4497250137207291}}} #metrics {"StartTime": 1616444879.1752746, "EndTime": 1616444879.1752841, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44329599621068805, "count": 1, "min": 0.44329599621068805, "max": 0.44329599621068805}}} #metrics {"StartTime": 1616444879.1753254, "EndTime": 1616444879.175337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500569471975411, "count": 1, "min": 0.4500569471975411, "max": 0.4500569471975411}}} #metrics {"StartTime": 1616444879.1753771, "EndTime": 1616444879.1753879, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44319879201280327, "count": 1, "min": 0.44319879201280327, "max": 0.44319879201280327}}} #metrics {"StartTime": 1616444879.1754222, "EndTime": 1616444879.1754308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500858742018763, "count": 1, "min": 0.4500858742018763, "max": 0.4500858742018763}}} #metrics {"StartTime": 1616444879.1754682, "EndTime": 1616444879.1754777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845708893401542, "count": 1, "min": 0.6845708893401542, "max": 0.6845708893401542}}} #metrics {"StartTime": 1616444879.1755142, "EndTime": 1616444879.1755223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847514603394702, "count": 1, "min": 0.6847514603394702, "max": 0.6847514603394702}}} #metrics {"StartTime": 1616444879.1755593, "EndTime": 1616444879.175569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847096641964157, "count": 1, "min": 0.6847096641964157, "max": 0.6847096641964157}}} #metrics {"StartTime": 1616444879.1756084, "EndTime": 1616444879.1756191, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847314690790722, "count": 1, "min": 0.6847314690790722, "max": 0.6847314690790722}}} #metrics {"StartTime": 1616444879.1756582, "EndTime": 1616444879.1756685, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850177228249873, "count": 1, "min": 0.6850177228249873, "max": 0.6850177228249873}}} #metrics {"StartTime": 1616444879.175706, "EndTime": 1616444879.1757166, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834116163079528, "count": 1, "min": 0.6834116163079528, "max": 0.6834116163079528}}} #metrics {"StartTime": 1616444879.1757555, "EndTime": 1616444879.1757653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849771637347271, "count": 1, "min": 0.6849771637347271, "max": 0.6849771637347271}}} #metrics {"StartTime": 1616444879.1758075, "EndTime": 1616444879.1758184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834691725577449, "count": 1, "min": 0.6834691725577449, "max": 0.6834691725577449}}} [03/22/2021 20:27:59 INFO 139804890085184] #quality_metric: host=algo-1, epoch=4, validation binary_classification_cross_entropy_objective <loss>=0.1599324948952218 [03/22/2021 20:27:59 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=sampled_accuracy, value=0.9504168884158241 [03/22/2021 20:27:59 INFO 139804890085184] Epoch 4: Loss improved. Updating best model [03/22/2021 20:27:59 INFO 139804890085184] Saving model for epoch: 4 [03/22/2021 20:27:59 INFO 139804890085184] Saved checkpoint to "/tmp/tmpg6a8mbe0/mx-mod-0000.params" [03/22/2021 20:27:59 INFO 139804890085184] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs #metrics {"StartTime": 1616444866.738855, "EndTime": 1616444879.1810327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2266805.0, "count": 1, "min": 2266805, "max": 2266805}, "Total Batches Seen": {"sum": 2267.0, "count": 1, "min": 2267, "max": 2267}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:27:59 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=36244.19263585458 records/second [2021-03-22 20:28:09.890] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 13, "duration": 10706, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444889.8902915, "EndTime": 1616444889.8903565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15805759045071072, "count": 1, "min": 0.15805759045071072, "max": 0.15805759045071072}}} #metrics {"StartTime": 1616444889.890431, "EndTime": 1616444889.8904445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14571451215955947, "count": 1, "min": 0.14571451215955947, "max": 0.14571451215955947}}} #metrics {"StartTime": 1616444889.8904862, "EndTime": 1616444889.8904984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1602517534383138, "count": 1, "min": 0.1602517534383138, "max": 0.1602517534383138}}} #metrics {"StartTime": 1616444889.8905287, "EndTime": 1616444889.890537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1462417325337728, "count": 1, "min": 0.1462417325337728, "max": 0.1462417325337728}}} #metrics {"StartTime": 1616444889.8905687, "EndTime": 1616444889.8905756, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885278011745877, "count": 1, "min": 0.13885278011745877, "max": 0.13885278011745877}}} #metrics {"StartTime": 1616444889.8906012, "EndTime": 1616444889.8906088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1417416631910536, "count": 1, "min": 0.1417416631910536, "max": 0.1417416631910536}}} #metrics {"StartTime": 1616444889.8906426, "EndTime": 1616444889.8906524, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13885016270955403, "count": 1, "min": 0.13885016270955403, "max": 0.13885016270955403}}} #metrics {"StartTime": 1616444889.8906996, "EndTime": 1616444889.890708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14173942157321506, "count": 1, "min": 0.14173942157321506, "max": 0.14173942157321506}}} #metrics {"StartTime": 1616444889.8907404, "EndTime": 1616444889.8907504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17625278147379558, "count": 1, "min": 0.17625278147379558, "max": 0.17625278147379558}}} #metrics {"StartTime": 1616444889.8907733, "EndTime": 1616444889.8907788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17342032874213326, "count": 1, "min": 0.17342032874213326, "max": 0.17342032874213326}}} #metrics {"StartTime": 1616444889.8908064, "EndTime": 1616444889.8908148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1756948014662001, "count": 1, "min": 0.1756948014662001, "max": 0.1756948014662001}}} #metrics {"StartTime": 1616444889.8908453, "EndTime": 1616444889.8908522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17340999576144747, "count": 1, "min": 0.17340999576144747, "max": 0.17340999576144747}}} #metrics {"StartTime": 1616444889.890882, "EndTime": 1616444889.8908908, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357845279269749, "count": 1, "min": 0.17357845279269749, "max": 0.17357845279269749}}} #metrics {"StartTime": 1616444889.8909256, "EndTime": 1616444889.8909338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753468990749783, "count": 1, "min": 0.1753468990749783, "max": 0.1753468990749783}}} #metrics {"StartTime": 1616444889.8909657, "EndTime": 1616444889.8909738, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17357762807210286, "count": 1, "min": 0.17357762807210286, "max": 0.17357762807210286}}} #metrics {"StartTime": 1616444889.891008, "EndTime": 1616444889.891015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753519529554579, "count": 1, "min": 0.1753519529554579, "max": 0.1753519529554579}}} #metrics {"StartTime": 1616444889.8910394, "EndTime": 1616444889.8910475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476870968967014, "count": 1, "min": 0.4476870968967014, "max": 0.4476870968967014}}} #metrics {"StartTime": 1616444889.8910813, "EndTime": 1616444889.89109, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780307406955294, "count": 1, "min": 0.44780307406955294, "max": 0.44780307406955294}}} #metrics {"StartTime": 1616444889.8911111, "EndTime": 1616444889.8911169, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768651306152346, "count": 1, "min": 0.44768651306152346, "max": 0.44768651306152346}}} #metrics {"StartTime": 1616444889.8911414, "EndTime": 1616444889.8911498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478024858262804, "count": 1, "min": 0.4478024858262804, "max": 0.4478024858262804}}} #metrics {"StartTime": 1616444889.8911827, "EndTime": 1616444889.8911908, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4478861978488498, "count": 1, "min": 0.4478861978488498, "max": 0.4478861978488498}}} #metrics {"StartTime": 1616444889.8912127, "EndTime": 1616444889.891218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44895931816948786, "count": 1, "min": 0.44895931816948786, "max": 0.44895931816948786}}} #metrics {"StartTime": 1616444889.8912368, "EndTime": 1616444889.8912418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44788617919921875, "count": 1, "min": 0.44788617919921875, "max": 0.44788617919921875}}} #metrics {"StartTime": 1616444889.8912685, "EndTime": 1616444889.891277, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44895975816514755, "count": 1, "min": 0.44895975816514755, "max": 0.44895975816514755}}} #metrics {"StartTime": 1616444889.8913095, "EndTime": 1616444889.8913155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847447668457032, "count": 1, "min": 0.6847447668457032, "max": 0.6847447668457032}}} #metrics {"StartTime": 1616444889.8913352, "EndTime": 1616444889.89134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848555231391059, "count": 1, "min": 0.6848555231391059, "max": 0.6848555231391059}}} #metrics {"StartTime": 1616444889.8913636, "EndTime": 1616444889.8913689, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847441624620225, "count": 1, "min": 0.6847441624620225, "max": 0.6847441624620225}}} #metrics {"StartTime": 1616444889.891388, "EndTime": 1616444889.891393, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848577107747396, "count": 1, "min": 0.6848577107747396, "max": 0.6848577107747396}}} #metrics {"StartTime": 1616444889.8914309, "EndTime": 1616444889.89144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.68497576171875, "count": 1, "min": 0.68497576171875, "max": 0.68497576171875}}} #metrics {"StartTime": 1616444889.8914726, "EndTime": 1616444889.8914783, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865579345703124, "count": 1, "min": 0.6865579345703124, "max": 0.6865579345703124}}} #metrics {"StartTime": 1616444889.891498, "EndTime": 1616444889.891503, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684975629204644, "count": 1, "min": 0.684975629204644, "max": 0.684975629204644}}} #metrics {"StartTime": 1616444889.8915217, "EndTime": 1616444889.8915267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686559906548394, "count": 1, "min": 0.686559906548394, "max": 0.686559906548394}}} [03/22/2021 20:28:09 INFO 139804890085184] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.15805759045071072 [2021-03-22 20:28:10.829] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 17, "duration": 922, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444891.513312, "EndTime": 1616444891.5133734, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15833553593696295, "count": 1, "min": 0.15833553593696295, "max": 0.15833553593696295}}} #metrics {"StartTime": 1616444891.5134413, "EndTime": 1616444891.5134513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14611494860497692, "count": 1, "min": 0.14611494860497692, "max": 0.14611494860497692}}} #metrics {"StartTime": 1616444891.5134845, "EndTime": 1616444891.5134935, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1603815507440464, "count": 1, "min": 0.1603815507440464, "max": 0.1603815507440464}}} #metrics {"StartTime": 1616444891.5135307, "EndTime": 1616444891.5135396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14657433533342845, "count": 1, "min": 0.14657433533342845, "max": 0.14657433533342845}}} #metrics {"StartTime": 1616444891.5135734, "EndTime": 1616444891.5135837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1403859322388713, "count": 1, "min": 0.1403859322388713, "max": 0.1403859322388713}}} #metrics {"StartTime": 1616444891.5136197, "EndTime": 1616444891.5136292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14268827264097875, "count": 1, "min": 0.14268827264097875, "max": 0.14268827264097875}}} #metrics {"StartTime": 1616444891.5136647, "EndTime": 1616444891.5136735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14038611481920169, "count": 1, "min": 0.14038611481920169, "max": 0.14038611481920169}}} #metrics {"StartTime": 1616444891.513695, "EndTime": 1616444891.5137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14268442803248035, "count": 1, "min": 0.14268442803248035, "max": 0.14268442803248035}}} #metrics {"StartTime": 1616444891.5137231, "EndTime": 1616444891.5137303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17683866323890976, "count": 1, "min": 0.17683866323890976, "max": 0.17683866323890976}}} #metrics {"StartTime": 1616444891.5137653, "EndTime": 1616444891.5137749, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415200700907074, "count": 1, "min": 0.17415200700907074, "max": 0.17415200700907074}}} #metrics {"StartTime": 1616444891.5138102, "EndTime": 1616444891.5138206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17633885736687083, "count": 1, "min": 0.17633885736687083, "max": 0.17633885736687083}}} #metrics {"StartTime": 1616444891.5138502, "EndTime": 1616444891.5138578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415386252058976, "count": 1, "min": 0.17415386252058976, "max": 0.17415386252058976}}} #metrics {"StartTime": 1616444891.5138884, "EndTime": 1616444891.5138974, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17447849792729503, "count": 1, "min": 0.17447849792729503, "max": 0.17447849792729503}}} #metrics {"StartTime": 1616444891.5139308, "EndTime": 1616444891.5139408, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17472683817058332, "count": 1, "min": 0.17472683817058332, "max": 0.17472683817058332}}} #metrics {"StartTime": 1616444891.5139756, "EndTime": 1616444891.5139859, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1744694652763774, "count": 1, "min": 0.1744694652763774, "max": 0.1744694652763774}}} #metrics {"StartTime": 1616444891.5140257, "EndTime": 1616444891.514035, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17467270506513188, "count": 1, "min": 0.17467270506513188, "max": 0.17467270506513188}}} #metrics {"StartTime": 1616444891.5140758, "EndTime": 1616444891.5140853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44949224613143, "count": 1, "min": 0.44949224613143, "max": 0.44949224613143}}} #metrics {"StartTime": 1616444891.5141218, "EndTime": 1616444891.5141308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44968481329457227, "count": 1, "min": 0.44968481329457227, "max": 0.44968481329457227}}} #metrics {"StartTime": 1616444891.5141652, "EndTime": 1616444891.5141747, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44952998192614435, "count": 1, "min": 0.44952998192614435, "max": 0.44952998192614435}}} #metrics {"StartTime": 1616444891.514207, "EndTime": 1616444891.514216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44969359501596246, "count": 1, "min": 0.44969359501596246, "max": 0.44969359501596246}}} #metrics {"StartTime": 1616444891.5142505, "EndTime": 1616444891.5142605, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44691241313236624, "count": 1, "min": 0.44691241313236624, "max": 0.44691241313236624}}} #metrics {"StartTime": 1616444891.514294, "EndTime": 1616444891.5143032, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506012515097999, "count": 1, "min": 0.4506012515097999, "max": 0.4506012515097999}}} #metrics {"StartTime": 1616444891.5143406, "EndTime": 1616444891.5143507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44686130065539004, "count": 1, "min": 0.44686130065539004, "max": 0.44686130065539004}}} #metrics {"StartTime": 1616444891.5143847, "EndTime": 1616444891.5143938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506126941128024, "count": 1, "min": 0.4506126941128024, "max": 0.4506126941128024}}} #metrics {"StartTime": 1616444891.5144255, "EndTime": 1616444891.5144353, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.68464277185234, "count": 1, "min": 0.68464277185234, "max": 0.68464277185234}}} #metrics {"StartTime": 1616444891.5144684, "EndTime": 1616444891.5144775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849058041954075, "count": 1, "min": 0.6849058041954075, "max": 0.6849058041954075}}} #metrics {"StartTime": 1616444891.5145113, "EndTime": 1616444891.5145214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847597174638549, "count": 1, "min": 0.6847597174638549, "max": 0.6847597174638549}}} #metrics {"StartTime": 1616444891.5145543, "EndTime": 1616444891.5145636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849591157570447, "count": 1, "min": 0.6849591157570447, "max": 0.6849591157570447}}} #metrics {"StartTime": 1616444891.514602, "EndTime": 1616444891.5146134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847650652133088, "count": 1, "min": 0.6847650652133088, "max": 0.6847650652133088}}} #metrics {"StartTime": 1616444891.514648, "EndTime": 1616444891.5146573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834993539390273, "count": 1, "min": 0.6834993539390273, "max": 0.6834993539390273}}} #metrics {"StartTime": 1616444891.5146892, "EndTime": 1616444891.514699, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846659672689581, "count": 1, "min": 0.6846659672689581, "max": 0.6846659672689581}}} #metrics {"StartTime": 1616444891.5147328, "EndTime": 1616444891.5147414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835336806652752, "count": 1, "min": 0.6835336806652752, "max": 0.6835336806652752}}} [03/22/2021 20:28:11 INFO 139804890085184] #quality_metric: host=algo-1, epoch=5, validation binary_classification_cross_entropy_objective <loss>=0.15833553593696295 [03/22/2021 20:28:11 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=sampled_accuracy, value=0.9504523682810007 [03/22/2021 20:28:11 INFO 139804890085184] Epoch 5: Loss improved. Updating best model [03/22/2021 20:28:11 INFO 139804890085184] Saving model for epoch: 5 [03/22/2021 20:28:11 INFO 139804890085184] Saved checkpoint to "/tmp/tmp1ot7rzjj/mx-mod-0000.params" [03/22/2021 20:28:11 INFO 139804890085184] #progress_metric: host=algo-1, completed 40.0 % of epochs #metrics {"StartTime": 1616444879.1834643, "EndTime": 1616444891.5204363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2717766.0, "count": 1, "min": 2717766, "max": 2717766}, "Total Batches Seen": {"sum": 2718.0, "count": 1, "min": 2718, "max": 2718}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:28:11 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=36553.3378330044 records/second [2021-03-22 20:28:21.579] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 15, "duration": 10056, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444901.5799499, "EndTime": 1616444901.580033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15674167098999023, "count": 1, "min": 0.15674167098999023, "max": 0.15674167098999023}}} #metrics {"StartTime": 1616444901.5801098, "EndTime": 1616444901.580126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14412725406222873, "count": 1, "min": 0.14412725406222873, "max": 0.14412725406222873}}} #metrics {"StartTime": 1616444901.5801644, "EndTime": 1616444901.5801752, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1587956749810113, "count": 1, "min": 0.1587956749810113, "max": 0.1587956749810113}}} #metrics {"StartTime": 1616444901.5802524, "EndTime": 1616444901.5802684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1445723391893175, "count": 1, "min": 0.1445723391893175, "max": 0.1445723391893175}}} #metrics {"StartTime": 1616444901.5803099, "EndTime": 1616444901.5803206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870962773640952, "count": 1, "min": 0.13870962773640952, "max": 0.13870962773640952}}} #metrics {"StartTime": 1616444901.580355, "EndTime": 1616444901.5803645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159801566229926, "count": 1, "min": 0.14159801566229926, "max": 0.14159801566229926}}} #metrics {"StartTime": 1616444901.5803971, "EndTime": 1616444901.5804067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13870781699286566, "count": 1, "min": 0.13870781699286566, "max": 0.13870781699286566}}} #metrics {"StartTime": 1616444901.5804405, "EndTime": 1616444901.5804498, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159739778306749, "count": 1, "min": 0.14159739778306749, "max": 0.14159739778306749}}} #metrics {"StartTime": 1616444901.5804818, "EndTime": 1616444901.5804915, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1756218012152778, "count": 1, "min": 0.1756218012152778, "max": 0.1756218012152778}}} #metrics {"StartTime": 1616444901.5805223, "EndTime": 1616444901.580531, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338862830268012, "count": 1, "min": 0.17338862830268012, "max": 0.17338862830268012}}} #metrics {"StartTime": 1616444901.5805671, "EndTime": 1616444901.5805764, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514744923909506, "count": 1, "min": 0.17514744923909506, "max": 0.17514744923909506}}} #metrics {"StartTime": 1616444901.5806153, "EndTime": 1616444901.5806239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338922051323785, "count": 1, "min": 0.17338922051323785, "max": 0.17338922051323785}}} #metrics {"StartTime": 1616444901.580657, "EndTime": 1616444901.5806656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1734556061469184, "count": 1, "min": 0.1734556061469184, "max": 0.1734556061469184}}} #metrics {"StartTime": 1616444901.5806992, "EndTime": 1616444901.5807095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.175313155992296, "count": 1, "min": 0.175313155992296, "max": 0.175313155992296}}} #metrics {"StartTime": 1616444901.580744, "EndTime": 1616444901.580753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17345546308729384, "count": 1, "min": 0.17345546308729384, "max": 0.17345546308729384}}} #metrics {"StartTime": 1616444901.5807874, "EndTime": 1616444901.5807965, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17531529303656684, "count": 1, "min": 0.17531529303656684, "max": 0.17531529303656684}}} #metrics {"StartTime": 1616444901.5808294, "EndTime": 1616444901.5808384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768542853461374, "count": 1, "min": 0.44768542853461374, "max": 0.44768542853461374}}} #metrics {"StartTime": 1616444901.580921, "EndTime": 1616444901.5809343, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477956295437283, "count": 1, "min": 0.4477956295437283, "max": 0.4477956295437283}}} #metrics {"StartTime": 1616444901.5809689, "EndTime": 1616444901.5809789, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476848326280382, "count": 1, "min": 0.4476848326280382, "max": 0.4476848326280382}}} #metrics {"StartTime": 1616444901.5810115, "EndTime": 1616444901.581021, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44779545878092447, "count": 1, "min": 0.44779545878092447, "max": 0.44779545878092447}}} #metrics {"StartTime": 1616444901.5810552, "EndTime": 1616444901.5810637, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780452195909287, "count": 1, "min": 0.44780452195909287, "max": 0.44780452195909287}}} #metrics {"StartTime": 1616444901.5810964, "EndTime": 1616444901.5811052, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44892684414333767, "count": 1, "min": 0.44892684414333767, "max": 0.44892684414333767}}} #metrics {"StartTime": 1616444901.5811381, "EndTime": 1616444901.581146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44780452189127606, "count": 1, "min": 0.44780452189127606, "max": 0.44780452189127606}}} #metrics {"StartTime": 1616444901.581183, "EndTime": 1616444901.5811925, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489271452501085, "count": 1, "min": 0.4489271452501085, "max": 0.4489271452501085}}} #metrics {"StartTime": 1616444901.581227, "EndTime": 1616444901.5812373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847385525173612, "count": 1, "min": 0.6847385525173612, "max": 0.6847385525173612}}} #metrics {"StartTime": 1616444901.5812724, "EndTime": 1616444901.5812814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848521270073785, "count": 1, "min": 0.6848521270073785, "max": 0.6848521270073785}}} #metrics {"StartTime": 1616444901.5813167, "EndTime": 1616444901.5813255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847382652452257, "count": 1, "min": 0.6847382652452257, "max": 0.6847382652452257}}} #metrics {"StartTime": 1616444901.5813599, "EndTime": 1616444901.5813687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684853183186849, "count": 1, "min": 0.684853183186849, "max": 0.684853183186849}}} #metrics {"StartTime": 1616444901.5814016, "EndTime": 1616444901.5814183, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848694337293837, "count": 1, "min": 0.6848694337293837, "max": 0.6848694337293837}}} #metrics {"StartTime": 1616444901.5814514, "EndTime": 1616444901.5814605, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865029622395833, "count": 1, "min": 0.6865029622395833, "max": 0.6865029622395833}}} #metrics {"StartTime": 1616444901.5814931, "EndTime": 1616444901.5815015, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848692616102431, "count": 1, "min": 0.6848692616102431, "max": 0.6848692616102431}}} #metrics {"StartTime": 1616444901.5815337, "EndTime": 1616444901.5815423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6865033993869357, "count": 1, "min": 0.6865033993869357, "max": 0.6865033993869357}}} [03/22/2021 20:28:21 INFO 139804890085184] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.15674167098999023 [2021-03-22 20:28:22.642] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 20, "duration": 1047, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444903.343507, "EndTime": 1616444903.3435755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15729632930001067, "count": 1, "min": 0.15729632930001067, "max": 0.15729632930001067}}} #metrics {"StartTime": 1616444903.3436499, "EndTime": 1616444903.3436604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14482136642296348, "count": 1, "min": 0.14482136642296348, "max": 0.14482136642296348}}} #metrics {"StartTime": 1616444903.3436852, "EndTime": 1616444903.3436913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1592287311618244, "count": 1, "min": 0.1592287311618244, "max": 0.1592287311618244}}} #metrics {"StartTime": 1616444903.3437262, "EndTime": 1616444903.343735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14521347128458853, "count": 1, "min": 0.14521347128458853, "max": 0.14521347128458853}}} #metrics {"StartTime": 1616444903.3437738, "EndTime": 1616444903.343785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402417209822171, "count": 1, "min": 0.1402417209822171, "max": 0.1402417209822171}}} #metrics {"StartTime": 1616444903.3438241, "EndTime": 1616444903.343834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14247228274938378, "count": 1, "min": 0.14247228274938378, "max": 0.14247228274938378}}} #metrics {"StartTime": 1616444903.3438637, "EndTime": 1616444903.3438723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024017290673993, "count": 1, "min": 0.14024017290673993, "max": 0.14024017290673993}}} #metrics {"StartTime": 1616444903.3439064, "EndTime": 1616444903.3439167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14247057943325506, "count": 1, "min": 0.14247057943325506, "max": 0.14247057943325506}}} #metrics {"StartTime": 1616444903.34395, "EndTime": 1616444903.3439593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17635393966612545, "count": 1, "min": 0.17635393966612545, "max": 0.17635393966612545}}} #metrics {"StartTime": 1616444903.343995, "EndTime": 1616444903.344004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414147480383863, "count": 1, "min": 0.17414147480383863, "max": 0.17414147480383863}}} #metrics {"StartTime": 1616444903.3440373, "EndTime": 1616444903.3440466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17591850384977326, "count": 1, "min": 0.17591850384977326, "max": 0.17591850384977326}}} #metrics {"StartTime": 1616444903.3440826, "EndTime": 1616444903.3440928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741464542796981, "count": 1, "min": 0.1741464542796981, "max": 0.1741464542796981}}} #metrics {"StartTime": 1616444903.3441336, "EndTime": 1616444903.3441436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433793340483011, "count": 1, "min": 0.17433793340483011, "max": 0.17433793340483011}}} #metrics {"StartTime": 1616444903.344182, "EndTime": 1616444903.3441927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17458673124937632, "count": 1, "min": 0.17458673124937632, "max": 0.17458673124937632}}} #metrics {"StartTime": 1616444903.3442326, "EndTime": 1616444903.3442423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17432918463993394, "count": 1, "min": 0.17432918463993394, "max": 0.17432918463993394}}} #metrics {"StartTime": 1616444903.3442855, "EndTime": 1616444903.3442972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1745361516254473, "count": 1, "min": 0.1745361516254473, "max": 0.1745361516254473}}} #metrics {"StartTime": 1616444903.3443346, "EndTime": 1616444903.3443437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4492792743644288, "count": 1, "min": 0.4492792743644288, "max": 0.4492792743644288}}} #metrics {"StartTime": 1616444903.3443756, "EndTime": 1616444903.344384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970079726184836, "count": 1, "min": 0.44970079726184836, "max": 0.44970079726184836}}} #metrics {"StartTime": 1616444903.3444152, "EndTime": 1616444903.3444238, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449310679534701, "count": 1, "min": 0.449310679534701, "max": 0.449310679534701}}} #metrics {"StartTime": 1616444903.344456, "EndTime": 1616444903.3444648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.449717922187008, "count": 1, "min": 0.449717922187008, "max": 0.449717922187008}}} #metrics {"StartTime": 1616444903.3444982, "EndTime": 1616444903.3445075, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44973075830156084, "count": 1, "min": 0.44973075830156084, "max": 0.44973075830156084}}} #metrics {"StartTime": 1616444903.3445463, "EndTime": 1616444903.3445547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064050695755303, "count": 1, "min": 0.45064050695755303, "max": 0.45064050695755303}}} #metrics {"StartTime": 1616444903.344587, "EndTime": 1616444903.3445966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44971973743340593, "count": 1, "min": 0.44971973743340593, "max": 0.44971973743340593}}} #metrics {"StartTime": 1616444903.3446305, "EndTime": 1616444903.34464, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45064273527672216, "count": 1, "min": 0.45064273527672216, "max": 0.45064273527672216}}} #metrics {"StartTime": 1616444903.3446705, "EndTime": 1616444903.3446798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847419878174824, "count": 1, "min": 0.6847419878174824, "max": 0.6847419878174824}}} #metrics {"StartTime": 1616444903.3447118, "EndTime": 1616444903.3447206, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849558720801007, "count": 1, "min": 0.6849558720801007, "max": 0.6849558720801007}}} #metrics {"StartTime": 1616444903.3447535, "EndTime": 1616444903.3447626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847582292108433, "count": 1, "min": 0.6847582292108433, "max": 0.6847582292108433}}} #metrics {"StartTime": 1616444903.3447914, "EndTime": 1616444903.3448005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851957704531548, "count": 1, "min": 0.6851957704531548, "max": 0.6851957704531548}}} #metrics {"StartTime": 1616444903.3448339, "EndTime": 1616444903.3448424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847497447069516, "count": 1, "min": 0.6847497447069516, "max": 0.6847497447069516}}} #metrics {"StartTime": 1616444903.3448892, "EndTime": 1616444903.3449001, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821593204245873, "count": 1, "min": 0.6821593204245873, "max": 0.6821593204245873}}} #metrics {"StartTime": 1616444903.3449292, "EndTime": 1616444903.344939, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846212021991973, "count": 1, "min": 0.6846212021991973, "max": 0.6846212021991973}}} #metrics {"StartTime": 1616444903.3449724, "EndTime": 1616444903.344982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821606914688768, "count": 1, "min": 0.6821606914688768, "max": 0.6821606914688768}}} [03/22/2021 20:28:23 INFO 139804890085184] #quality_metric: host=algo-1, epoch=6, validation binary_classification_cross_entropy_objective <loss>=0.15729632930001067 [03/22/2021 20:28:23 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:28:23 INFO 139804890085184] Epoch 6: Loss improved. Updating best model [03/22/2021 20:28:23 INFO 139804890085184] Saving model for epoch: 6 [03/22/2021 20:28:23 INFO 139804890085184] Saved checkpoint to "/tmp/tmpf2issvf6/mx-mod-0000.params" [03/22/2021 20:28:23 INFO 139804890085184] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs #metrics {"StartTime": 1616444891.5232384, "EndTime": 1616444903.3502629, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3168727.0, "count": 1, "min": 3168727, "max": 3168727}, "Total Batches Seen": {"sum": 3169.0, "count": 1, "min": 3169, "max": 3169}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:28:23 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38129.35764695632 records/second [2021-03-22 20:28:33.326] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 17, "duration": 9973, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444913.3261857, "EndTime": 1616444913.3262599, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15587011411878798, "count": 1, "min": 0.15587011411878798, "max": 0.15587011411878798}}} #metrics {"StartTime": 1616444913.3263373, "EndTime": 1616444913.3263505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14294777369181316, "count": 1, "min": 0.14294777369181316, "max": 0.14294777369181316}}} #metrics {"StartTime": 1616444913.3263772, "EndTime": 1616444913.3263834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15782798594156902, "count": 1, "min": 0.15782798594156902, "max": 0.15782798594156902}}} #metrics {"StartTime": 1616444913.326408, "EndTime": 1616444913.3264167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14333093112521703, "count": 1, "min": 0.14333093112521703, "max": 0.14333093112521703}}} #metrics {"StartTime": 1616444913.3264418, "EndTime": 1616444913.3264503, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13859164901733398, "count": 1, "min": 0.13859164901733398, "max": 0.13859164901733398}}} #metrics {"StartTime": 1616444913.3264782, "EndTime": 1616444913.326484, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14146294364081488, "count": 1, "min": 0.14146294364081488, "max": 0.14146294364081488}}} #metrics {"StartTime": 1616444913.3265042, "EndTime": 1616444913.326509, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13859015547010634, "count": 1, "min": 0.13859015547010634, "max": 0.13859015547010634}}} #metrics {"StartTime": 1616444913.326537, "EndTime": 1616444913.3265429, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1414628227403429, "count": 1, "min": 0.1414628227403429, "max": 0.1414628227403429}}} #metrics {"StartTime": 1616444913.326563, "EndTime": 1616444913.326568, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.175226802605523, "count": 1, "min": 0.175226802605523, "max": 0.175226802605523}}} #metrics {"StartTime": 1616444913.3265872, "EndTime": 1616444913.3265922, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338137756347657, "count": 1, "min": 0.17338137756347657, "max": 0.17338137756347657}}} #metrics {"StartTime": 1616444913.3266194, "EndTime": 1616444913.326625, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17480793318006727, "count": 1, "min": 0.17480793318006727, "max": 0.17480793318006727}}} #metrics {"StartTime": 1616444913.3266447, "EndTime": 1616444913.32665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17338225986056857, "count": 1, "min": 0.17338225986056857, "max": 0.17338225986056857}}} #metrics {"StartTime": 1616444913.3266687, "EndTime": 1616444913.326674, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733877603149414, "count": 1, "min": 0.1733877603149414, "max": 0.1733877603149414}}} #metrics {"StartTime": 1616444913.3267014, "EndTime": 1616444913.326709, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1752830019124349, "count": 1, "min": 0.1752830019124349, "max": 0.1752830019124349}}} #metrics {"StartTime": 1616444913.3267384, "EndTime": 1616444913.3267443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733875673421224, "count": 1, "min": 0.1733875673421224, "max": 0.1733875673421224}}} #metrics {"StartTime": 1616444913.3267639, "EndTime": 1616444913.3267689, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17528512013753256, "count": 1, "min": 0.17528512013753256, "max": 0.17528512013753256}}} #metrics {"StartTime": 1616444913.3267884, "EndTime": 1616444913.3267944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768268948025175, "count": 1, "min": 0.44768268948025175, "max": 0.44768268948025175}}} #metrics {"StartTime": 1616444913.3268197, "EndTime": 1616444913.3268251, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477903509521484, "count": 1, "min": 0.4477903509521484, "max": 0.4477903509521484}}} #metrics {"StartTime": 1616444913.3268442, "EndTime": 1616444913.3268492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768261427137584, "count": 1, "min": 0.44768261427137584, "max": 0.44768261427137584}}} #metrics {"StartTime": 1616444913.326868, "EndTime": 1616444913.326875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477903325737847, "count": 1, "min": 0.4477903325737847, "max": 0.4477903325737847}}} #metrics {"StartTime": 1616444913.326899, "EndTime": 1616444913.3269043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775570414225263, "count": 1, "min": 0.44775570414225263, "max": 0.44775570414225263}}} #metrics {"StartTime": 1616444913.3269234, "EndTime": 1616444913.3269281, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489047344970703, "count": 1, "min": 0.4489047344970703, "max": 0.4489047344970703}}} #metrics {"StartTime": 1616444913.326947, "EndTime": 1616444913.3269534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477557501220703, "count": 1, "min": 0.4477557501220703, "max": 0.4477557501220703}}} #metrics {"StartTime": 1616444913.3269794, "EndTime": 1616444913.3269875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4489047916666667, "count": 1, "min": 0.4489047916666667, "max": 0.4489047916666667}}} #metrics {"StartTime": 1616444913.3270195, "EndTime": 1616444913.3270288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847345886230469, "count": 1, "min": 0.6847345886230469, "max": 0.6847345886230469}}} #metrics {"StartTime": 1616444913.3270628, "EndTime": 1616444913.327072, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848488883463542, "count": 1, "min": 0.6848488883463542, "max": 0.6848488883463542}}} #metrics {"StartTime": 1616444913.327106, "EndTime": 1616444913.3271153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847346792263455, "count": 1, "min": 0.6847346792263455, "max": 0.6847346792263455}}} #metrics {"StartTime": 1616444913.3271503, "EndTime": 1616444913.3271596, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848486615668403, "count": 1, "min": 0.6848486615668403, "max": 0.6848486615668403}}} #metrics {"StartTime": 1616444913.3272011, "EndTime": 1616444913.3272126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848240903049045, "count": 1, "min": 0.6848240903049045, "max": 0.6848240903049045}}} #metrics {"StartTime": 1616444913.327253, "EndTime": 1616444913.3272626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6864386600748698, "count": 1, "min": 0.6864386600748698, "max": 0.6864386600748698}}} #metrics {"StartTime": 1616444913.327302, "EndTime": 1616444913.3273118, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848247832573785, "count": 1, "min": 0.6848247832573785, "max": 0.6848247832573785}}} #metrics {"StartTime": 1616444913.3273497, "EndTime": 1616444913.3273594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686438821750217, "count": 1, "min": 0.686438821750217, "max": 0.686438821750217}}} [03/22/2021 20:28:33 INFO 139804890085184] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.15587011411878798 [2021-03-22 20:28:34.371] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 23, "duration": 1030, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444915.0363119, "EndTime": 1616444915.0363755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15660224252714003, "count": 1, "min": 0.15660224252714003, "max": 0.15660224252714003}}} #metrics {"StartTime": 1616444915.036445, "EndTime": 1616444915.0364552, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14384278775699513, "count": 1, "min": 0.14384278775699513, "max": 0.14384278775699513}}} #metrics {"StartTime": 1616444915.0364797, "EndTime": 1616444915.036486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15845505174897717, "count": 1, "min": 0.15845505174897717, "max": 0.15845505174897717}}} #metrics {"StartTime": 1616444915.0365188, "EndTime": 1616444915.0365276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1441764874853351, "count": 1, "min": 0.1441764874853351, "max": 0.1441764874853351}}} #metrics {"StartTime": 1616444915.0365617, "EndTime": 1616444915.0365698, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14024619129039473, "count": 1, "min": 0.14024619129039473, "max": 0.14024619129039473}}} #metrics {"StartTime": 1616444915.0366027, "EndTime": 1616444915.036611, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14236691339400426, "count": 1, "min": 0.14236691339400426, "max": 0.14236691339400426}}} #metrics {"StartTime": 1616444915.0366473, "EndTime": 1616444915.0366569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.140244468484594, "count": 1, "min": 0.140244468484594, "max": 0.140244468484594}}} #metrics {"StartTime": 1616444915.0366926, "EndTime": 1616444915.0367026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1423659430384234, "count": 1, "min": 0.1423659430384234, "max": 0.1423659430384234}}} #metrics {"StartTime": 1616444915.0367372, "EndTime": 1616444915.0367465, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17604264060888855, "count": 1, "min": 0.17604264060888855, "max": 0.17604264060888855}}} #metrics {"StartTime": 1616444915.036777, "EndTime": 1616444915.0367832, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414621174155726, "count": 1, "min": 0.17414621174155726, "max": 0.17414621174155726}}} #metrics {"StartTime": 1616444915.0368028, "EndTime": 1616444915.036808, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1756515685645363, "count": 1, "min": 0.1756515685645363, "max": 0.1756515685645363}}} #metrics {"StartTime": 1616444915.036837, "EndTime": 1616444915.0368462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415231958822047, "count": 1, "min": 0.17415231958822047, "max": 0.17415231958822047}}} #metrics {"StartTime": 1616444915.0368917, "EndTime": 1616444915.0369003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420705403126108, "count": 1, "min": 0.17420705403126108, "max": 0.17420705403126108}}} #metrics {"StartTime": 1616444915.0369327, "EndTime": 1616444915.0369413, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17463605893256712, "count": 1, "min": 0.17463605893256712, "max": 0.17463605893256712}}} #metrics {"StartTime": 1616444915.0369742, "EndTime": 1616444915.0369825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742028167870782, "count": 1, "min": 0.1742028167870782, "max": 0.1742028167870782}}} #metrics {"StartTime": 1616444915.0370162, "EndTime": 1616444915.0370245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17459017334200927, "count": 1, "min": 0.17459017334200927, "max": 0.17459017334200927}}} #metrics {"StartTime": 1616444915.0370605, "EndTime": 1616444915.037069, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4491106702944309, "count": 1, "min": 0.4491106702944309, "max": 0.4491106702944309}}} #metrics {"StartTime": 1616444915.0370986, "EndTime": 1616444915.0371044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497098383041525, "count": 1, "min": 0.4497098383041525, "max": 0.4497098383041525}}} #metrics {"StartTime": 1616444915.0371275, "EndTime": 1616444915.0371327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912775759369594, "count": 1, "min": 0.44912775759369594, "max": 0.44912775759369594}}} #metrics {"StartTime": 1616444915.0371559, "EndTime": 1616444915.0371633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497276182988444, "count": 1, "min": 0.4497276182988444, "max": 0.4497276182988444}}} #metrics {"StartTime": 1616444915.0371838, "EndTime": 1616444915.037189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45058305790095715, "count": 1, "min": 0.45058305790095715, "max": 0.45058305790095715}}} #metrics {"StartTime": 1616444915.0372088, "EndTime": 1616444915.037214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45015649313365863, "count": 1, "min": 0.45015649313365863, "max": 0.45015649313365863}}} #metrics {"StartTime": 1616444915.0372372, "EndTime": 1616444915.0372443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4505792476700747, "count": 1, "min": 0.4505792476700747, "max": 0.4505792476700747}}} #metrics {"StartTime": 1616444915.0372677, "EndTime": 1616444915.0372732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501572654119129, "count": 1, "min": 0.4501572654119129, "max": 0.4501572654119129}}} #metrics {"StartTime": 1616444915.037292, "EndTime": 1616444915.037297, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847964227421605, "count": 1, "min": 0.6847964227421605, "max": 0.6847964227421605}}} #metrics {"StartTime": 1616444915.03732, "EndTime": 1616444915.0373285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849860835079608, "count": 1, "min": 0.6849860835079608, "max": 0.6849860835079608}}} #metrics {"StartTime": 1616444915.0373495, "EndTime": 1616444915.0373547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847697216207854, "count": 1, "min": 0.6847697216207854, "max": 0.6847697216207854}}} #metrics {"StartTime": 1616444915.0373738, "EndTime": 1616444915.0373788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853051516357118, "count": 1, "min": 0.6853051516357118, "max": 0.6853051516357118}}} #metrics {"StartTime": 1616444915.0374024, "EndTime": 1616444915.0374098, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684569206731802, "count": 1, "min": 0.684569206731802, "max": 0.684569206731802}}} #metrics {"StartTime": 1616444915.0374348, "EndTime": 1616444915.0374403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6822623073705781, "count": 1, "min": 0.6822623073705781, "max": 0.6822623073705781}}} #metrics {"StartTime": 1616444915.0374613, "EndTime": 1616444915.037466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844077978697528, "count": 1, "min": 0.6844077978697528, "max": 0.6844077978697528}}} #metrics {"StartTime": 1616444915.037489, "EndTime": 1616444915.0374963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6822624654534736, "count": 1, "min": 0.6822624654534736, "max": 0.6822624654534736}}} [03/22/2021 20:28:35 INFO 139804890085184] #quality_metric: host=algo-1, epoch=7, validation binary_classification_cross_entropy_objective <loss>=0.15660224252714003 [03/22/2021 20:28:35 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:28:35 INFO 139804890085184] Epoch 7: Loss improved. Updating best model [03/22/2021 20:28:35 INFO 139804890085184] Saving model for epoch: 7 [03/22/2021 20:28:35 INFO 139804890085184] Saved checkpoint to "/tmp/tmp8z66boif/mx-mod-0000.params" [03/22/2021 20:28:35 INFO 139804890085184] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs #metrics {"StartTime": 1616444903.3528214, "EndTime": 1616444915.043158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3619688.0, "count": 1, "min": 3619688, "max": 3619688}, "Total Batches Seen": {"sum": 3620.0, "count": 1, "min": 3620, "max": 3620}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:28:35 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38575.21621548422 records/second [2021-03-22 20:28:45.236] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 19, "duration": 10190, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444925.2366455, "EndTime": 1616444925.2368207, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15528282730102538, "count": 1, "min": 0.15528282730102538, "max": 0.15528282730102538}}} #metrics {"StartTime": 1616444925.2369013, "EndTime": 1616444925.2369146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14202935670640734, "count": 1, "min": 0.14202935670640734, "max": 0.14202935670640734}}} #metrics {"StartTime": 1616444925.2369568, "EndTime": 1616444925.2369683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1571711131117079, "count": 1, "min": 0.1571711131117079, "max": 0.1571711131117079}}} #metrics {"StartTime": 1616444925.2370033, "EndTime": 1616444925.2370133, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14235930013020834, "count": 1, "min": 0.14235930013020834, "max": 0.14235930013020834}}} #metrics {"StartTime": 1616444925.2370522, "EndTime": 1616444925.237063, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13852168870713977, "count": 1, "min": 0.13852168870713977, "max": 0.13852168870713977}}} #metrics {"StartTime": 1616444925.2370973, "EndTime": 1616444925.2371068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14134579876369902, "count": 1, "min": 0.14134579876369902, "max": 0.14134579876369902}}} #metrics {"StartTime": 1616444925.237142, "EndTime": 1616444925.2371519, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1385202998691135, "count": 1, "min": 0.1385202998691135, "max": 0.1385202998691135}}} #metrics {"StartTime": 1616444925.2371843, "EndTime": 1616444925.2371938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1413458609178331, "count": 1, "min": 0.1413458609178331, "max": 0.1413458609178331}}} #metrics {"StartTime": 1616444925.237232, "EndTime": 1616444925.2372434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496830593532986, "count": 1, "min": 0.17496830593532986, "max": 0.17496830593532986}}} #metrics {"StartTime": 1616444925.2372854, "EndTime": 1616444925.2372956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337708777533636, "count": 1, "min": 0.17337708777533636, "max": 0.17337708777533636}}} #metrics {"StartTime": 1616444925.2373343, "EndTime": 1616444925.2373447, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17458652238633898, "count": 1, "min": 0.17458652238633898, "max": 0.17458652238633898}}} #metrics {"StartTime": 1616444925.237386, "EndTime": 1616444925.237397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337771714952258, "count": 1, "min": 0.17337771714952258, "max": 0.17337771714952258}}} #metrics {"StartTime": 1616444925.2374375, "EndTime": 1616444925.2374482, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733297223578559, "count": 1, "min": 0.1733297223578559, "max": 0.1733297223578559}}} #metrics {"StartTime": 1616444925.2374845, "EndTime": 1616444925.2374933, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1752410048760308, "count": 1, "min": 0.1752410048760308, "max": 0.1752410048760308}}} #metrics {"StartTime": 1616444925.2375278, "EndTime": 1616444925.2375364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17332956800672744, "count": 1, "min": 0.17332956800672744, "max": 0.17332956800672744}}} #metrics {"StartTime": 1616444925.2375712, "EndTime": 1616444925.2375798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.175242649875217, "count": 1, "min": 0.175242649875217, "max": 0.175242649875217}}} #metrics {"StartTime": 1616444925.2376146, "EndTime": 1616444925.237623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768099514431425, "count": 1, "min": 0.44768099514431425, "max": 0.44768099514431425}}} #metrics {"StartTime": 1616444925.2376597, "EndTime": 1616444925.2376697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44778425957573786, "count": 1, "min": 0.44778425957573786, "max": 0.44778425957573786}}} #metrics {"StartTime": 1616444925.2377095, "EndTime": 1616444925.23772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768149922688805, "count": 1, "min": 0.44768149922688805, "max": 0.44768149922688805}}} #metrics {"StartTime": 1616444925.237762, "EndTime": 1616444925.2377727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477842709011502, "count": 1, "min": 0.4477842709011502, "max": 0.4477842709011502}}} #metrics {"StartTime": 1616444925.2378135, "EndTime": 1616444925.2378235, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477248337809245, "count": 1, "min": 0.4477248337809245, "max": 0.4477248337809245}}} #metrics {"StartTime": 1616444925.2378628, "EndTime": 1616444925.2378728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4488536903889974, "count": 1, "min": 0.4488536903889974, "max": 0.4488536903889974}}} #metrics {"StartTime": 1616444925.2379117, "EndTime": 1616444925.237921, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44772474012586805, "count": 1, "min": 0.44772474012586805, "max": 0.44772474012586805}}} #metrics {"StartTime": 1616444925.2379584, "EndTime": 1616444925.2379682, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44885365600585936, "count": 1, "min": 0.44885365600585936, "max": 0.44885365600585936}}} #metrics {"StartTime": 1616444925.238005, "EndTime": 1616444925.2380137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320955403646, "count": 1, "min": 0.6847320955403646, "max": 0.6847320955403646}}} #metrics {"StartTime": 1616444925.23805, "EndTime": 1616444925.2380583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848452601453993, "count": 1, "min": 0.6848452601453993, "max": 0.6848452601453993}}} #metrics {"StartTime": 1616444925.2380931, "EndTime": 1616444925.2381034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847326043023003, "count": 1, "min": 0.6847326043023003, "max": 0.6847326043023003}}} #metrics {"StartTime": 1616444925.2381382, "EndTime": 1616444925.2381475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848448480902778, "count": 1, "min": 0.6848448480902778, "max": 0.6848448480902778}}} #metrics {"StartTime": 1616444925.2381835, "EndTime": 1616444925.238193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847987447102865, "count": 1, "min": 0.6847987447102865, "max": 0.6847987447102865}}} #metrics {"StartTime": 1616444925.238219, "EndTime": 1616444925.2382267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863899917263455, "count": 1, "min": 0.6863899917263455, "max": 0.6863899917263455}}} #metrics {"StartTime": 1616444925.238261, "EndTime": 1616444925.2382708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847984894476996, "count": 1, "min": 0.6847984894476996, "max": 0.6847984894476996}}} #metrics {"StartTime": 1616444925.2383046, "EndTime": 1616444925.2383137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863900553385417, "count": 1, "min": 0.6863900553385417, "max": 0.6863900553385417}}} [03/22/2021 20:28:45 INFO 139804890085184] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.15528282730102538 [2021-03-22 20:28:46.323] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 26, "duration": 1072, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444927.0415478, "EndTime": 1616444927.0416417, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15613336622323765, "count": 1, "min": 0.15613336622323765, "max": 0.15613336622323765}}} #metrics {"StartTime": 1616444927.0417373, "EndTime": 1616444927.0417528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1430858971401375, "count": 1, "min": 0.1430858971401375, "max": 0.1430858971401375}}} #metrics {"StartTime": 1616444927.0417993, "EndTime": 1616444927.0418117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15791797702228302, "count": 1, "min": 0.15791797702228302, "max": 0.15791797702228302}}} #metrics {"StartTime": 1616444927.0418541, "EndTime": 1616444927.0418658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1433685165359256, "count": 1, "min": 0.1433685165359256, "max": 0.1433685165359256}}} #metrics {"StartTime": 1616444927.0419068, "EndTime": 1616444927.0419178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026178979526835, "count": 1, "min": 0.14026178979526835, "max": 0.14026178979526835}}} #metrics {"StartTime": 1616444927.041956, "EndTime": 1616444927.041966, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1422074221668037, "count": 1, "min": 0.1422074221668037, "max": 0.1422074221668037}}} #metrics {"StartTime": 1616444927.042008, "EndTime": 1616444927.0420198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14026066061239495, "count": 1, "min": 0.14026066061239495, "max": 0.14026066061239495}}} #metrics {"StartTime": 1616444927.0420613, "EndTime": 1616444927.042072, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220672784723754, "count": 1, "min": 0.14220672784723754, "max": 0.14220672784723754}}} #metrics {"StartTime": 1616444927.0421097, "EndTime": 1616444927.0421197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17583435285973256, "count": 1, "min": 0.17583435285973256, "max": 0.17583435285973256}}} #metrics {"StartTime": 1616444927.0421593, "EndTime": 1616444927.0421698, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17415330659122952, "count": 1, "min": 0.17415330659122952, "max": 0.17415330659122952}}} #metrics {"StartTime": 1616444927.0422046, "EndTime": 1616444927.0422144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1754717469701789, "count": 1, "min": 0.1754717469701789, "max": 0.1754717469701789}}} #metrics {"StartTime": 1616444927.0422487, "EndTime": 1616444927.0422568, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741601109906505, "count": 1, "min": 0.1741601109906505, "max": 0.1741601109906505}}} #metrics {"StartTime": 1616444927.042291, "EndTime": 1616444927.0423002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17425598677790333, "count": 1, "min": 0.17425598677790333, "max": 0.17425598677790333}}} #metrics {"StartTime": 1616444927.0423338, "EndTime": 1616444927.0423431, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1749528321514363, "count": 1, "min": 0.1749528321514363, "max": 0.1749528321514363}}} #metrics {"StartTime": 1616444927.0423765, "EndTime": 1616444927.0423863, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742539160002498, "count": 1, "min": 0.1742539160002498, "max": 0.1742539160002498}}} #metrics {"StartTime": 1616444927.04242, "EndTime": 1616444927.0424294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17491748763120446, "count": 1, "min": 0.17491748763120446, "max": 0.17491748763120446}}} #metrics {"StartTime": 1616444927.0424633, "EndTime": 1616444927.042472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44897305805124416, "count": 1, "min": 0.44897305805124416, "max": 0.44897305805124416}}} #metrics {"StartTime": 1616444927.0425048, "EndTime": 1616444927.0425131, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44977542402813236, "count": 1, "min": 0.44977542402813236, "max": 0.44977542402813236}}} #metrics {"StartTime": 1616444927.0425475, "EndTime": 1616444927.0425558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490292134808589, "count": 1, "min": 0.4490292134808589, "max": 0.4490292134808589}}} #metrics {"StartTime": 1616444927.042588, "EndTime": 1616444927.0425956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497906332809451, "count": 1, "min": 0.4497906332809451, "max": 0.4497906332809451}}} #metrics {"StartTime": 1616444927.042626, "EndTime": 1616444927.0426342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501909267824128, "count": 1, "min": 0.4501909267824128, "max": 0.4501909267824128}}} #metrics {"StartTime": 1616444927.0426657, "EndTime": 1616444927.0426736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499555735632907, "count": 1, "min": 0.4499555735632907, "max": 0.4499555735632907}}} #metrics {"StartTime": 1616444927.0427032, "EndTime": 1616444927.042711, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45019314373260655, "count": 1, "min": 0.45019314373260655, "max": 0.45019314373260655}}} #metrics {"StartTime": 1616444927.0427418, "EndTime": 1616444927.0427504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4499569191627306, "count": 1, "min": 0.4499569191627306, "max": 0.4499569191627306}}} #metrics {"StartTime": 1616444927.0427823, "EndTime": 1616444927.0427904, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847951031289499, "count": 1, "min": 0.6847951031289499, "max": 0.6847951031289499}}} #metrics {"StartTime": 1616444927.0428216, "EndTime": 1616444927.04283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6850502911497139, "count": 1, "min": 0.6850502911497139, "max": 0.6850502911497139}}} #metrics {"StartTime": 1616444927.042862, "EndTime": 1616444927.0428715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847619682502848, "count": 1, "min": 0.6847619682502848, "max": 0.6847619682502848}}} #metrics {"StartTime": 1616444927.0429063, "EndTime": 1616444927.0429153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852790733717722, "count": 1, "min": 0.6852790733717722, "max": 0.6852790733717722}}} #metrics {"StartTime": 1616444927.04295, "EndTime": 1616444927.0429583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842289406081262, "count": 1, "min": 0.6842289406081262, "max": 0.6842289406081262}}} #metrics {"StartTime": 1616444927.042993, "EndTime": 1616444927.0430021, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835660738536434, "count": 1, "min": 0.6835660738536434, "max": 0.6835660738536434}}} #metrics {"StartTime": 1616444927.0430348, "EndTime": 1616444927.0430439, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842748693737215, "count": 1, "min": 0.6842748693737215, "max": 0.6842748693737215}}} #metrics {"StartTime": 1616444927.0430753, "EndTime": 1616444927.0430837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835661369243877, "count": 1, "min": 0.6835661369243877, "max": 0.6835661369243877}}} [03/22/2021 20:28:47 INFO 139804890085184] #quality_metric: host=algo-1, epoch=8, validation binary_classification_cross_entropy_objective <loss>=0.15613336622323765 [03/22/2021 20:28:47 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=sampled_accuracy, value=0.9503991484832358 [03/22/2021 20:28:47 INFO 139804890085184] Epoch 8: Loss improved. Updating best model [03/22/2021 20:28:47 INFO 139804890085184] Saving model for epoch: 8 [03/22/2021 20:28:47 INFO 139804890085184] Saved checkpoint to "/tmp/tmp71u9ud92/mx-mod-0000.params" [03/22/2021 20:28:47 INFO 139804890085184] #progress_metric: host=algo-1, completed 60.0 % of epochs #metrics {"StartTime": 1616444915.046087, "EndTime": 1616444927.050313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4070649.0, "count": 1, "min": 4070649, "max": 4070649}, "Total Batches Seen": {"sum": 4071.0, "count": 1, "min": 4071, "max": 4071}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:28:47 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=37566.47833937069 records/second [2021-03-22 20:28:57.099] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 21, "duration": 10046, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444937.0997005, "EndTime": 1616444937.099776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15488599800957573, "count": 1, "min": 0.15488599800957573, "max": 0.15488599800957573}}} #metrics {"StartTime": 1616444937.099849, "EndTime": 1616444937.0998635, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14132234868367513, "count": 1, "min": 0.14132234868367513, "max": 0.14132234868367513}}} #metrics {"StartTime": 1616444937.0999043, "EndTime": 1616444937.099915, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15664956976996527, "count": 1, "min": 0.15664956976996527, "max": 0.15664956976996527}}} #metrics {"StartTime": 1616444937.0999534, "EndTime": 1616444937.0999649, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14159552493625216, "count": 1, "min": 0.14159552493625216, "max": 0.14159552493625216}}} #metrics {"StartTime": 1616444937.1000001, "EndTime": 1616444937.1000097, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384789872233073, "count": 1, "min": 0.1384789872233073, "max": 0.1384789872233073}}} #metrics {"StartTime": 1616444937.1000445, "EndTime": 1616444937.1000552, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14122574094984267, "count": 1, "min": 0.14122574094984267, "max": 0.14122574094984267}}} #metrics {"StartTime": 1616444937.1001043, "EndTime": 1616444937.1001146, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13847764587402345, "count": 1, "min": 0.13847764587402345, "max": 0.13847764587402345}}} #metrics {"StartTime": 1616444937.1001492, "EndTime": 1616444937.1001585, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1412256788804796, "count": 1, "min": 0.1412256788804796, "max": 0.1412256788804796}}} #metrics {"StartTime": 1616444937.1001918, "EndTime": 1616444937.1002002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1747946033053928, "count": 1, "min": 0.1747946033053928, "max": 0.1747946033053928}}} #metrics {"StartTime": 1616444937.1002343, "EndTime": 1616444937.1002443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337308268229168, "count": 1, "min": 0.17337308268229168, "max": 0.17337308268229168}}} #metrics {"StartTime": 1616444937.1002736, "EndTime": 1616444937.1002831, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1744185739135742, "count": 1, "min": 0.1744185739135742, "max": 0.1744185739135742}}} #metrics {"StartTime": 1616444937.1003082, "EndTime": 1616444937.100317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17337383541531032, "count": 1, "min": 0.17337383541531032, "max": 0.17337383541531032}}} #metrics {"StartTime": 1616444937.1003463, "EndTime": 1616444937.1003559, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17328997538248697, "count": 1, "min": 0.17328997538248697, "max": 0.17328997538248697}}} #metrics {"StartTime": 1616444937.1003854, "EndTime": 1616444937.1003952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520598887125652, "count": 1, "min": 0.17520598887125652, "max": 0.17520598887125652}}} #metrics {"StartTime": 1616444937.1004245, "EndTime": 1616444937.1004333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17328982937282986, "count": 1, "min": 0.17328982937282986, "max": 0.17328982937282986}}} #metrics {"StartTime": 1616444937.1004667, "EndTime": 1616444937.1004755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17520685238308376, "count": 1, "min": 0.17520685238308376, "max": 0.17520685238308376}}} #metrics {"StartTime": 1616444937.100501, "EndTime": 1616444937.10051, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476799557834201, "count": 1, "min": 0.4476799557834201, "max": 0.4476799557834201}}} #metrics {"StartTime": 1616444937.1005428, "EndTime": 1616444937.1005518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477800254313151, "count": 1, "min": 0.4477800254313151, "max": 0.4477800254313151}}} #metrics {"StartTime": 1616444937.100583, "EndTime": 1616444937.1005914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476794957139757, "count": 1, "min": 0.4476794957139757, "max": 0.4476794957139757}}} #metrics {"StartTime": 1616444937.1006227, "EndTime": 1616444937.100631, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477800233968099, "count": 1, "min": 0.4477800233968099, "max": 0.4477800233968099}}} #metrics {"StartTime": 1616444937.1006644, "EndTime": 1616444937.1006722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477208684624566, "count": 1, "min": 0.4477208684624566, "max": 0.4477208684624566}}} #metrics {"StartTime": 1616444937.1007044, "EndTime": 1616444937.1007125, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.448791940375434, "count": 1, "min": 0.448791940375434, "max": 0.448791940375434}}} #metrics {"StartTime": 1616444937.1007445, "EndTime": 1616444937.1007528, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44772082377115885, "count": 1, "min": 0.44772082377115885, "max": 0.44772082377115885}}} #metrics {"StartTime": 1616444937.1007867, "EndTime": 1616444937.1007967, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487919085015191, "count": 1, "min": 0.4487919085015191, "max": 0.4487919085015191}}} #metrics {"StartTime": 1616444937.1008275, "EndTime": 1616444937.1008365, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847305651855469, "count": 1, "min": 0.6847305651855469, "max": 0.6847305651855469}}} #metrics {"StartTime": 1616444937.1008878, "EndTime": 1616444937.100897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848417443847656, "count": 1, "min": 0.6848417443847656, "max": 0.6848417443847656}}} #metrics {"StartTime": 1616444937.1009336, "EndTime": 1616444937.1009426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320232476128, "count": 1, "min": 0.6847320232476128, "max": 0.6847320232476128}}} #metrics {"StartTime": 1616444937.1009772, "EndTime": 1616444937.100986, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848415671115451, "count": 1, "min": 0.6848415671115451, "max": 0.6848415671115451}}} #metrics {"StartTime": 1616444937.1010208, "EndTime": 1616444937.10103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684777204047309, "count": 1, "min": 0.684777204047309, "max": 0.684777204047309}}} #metrics {"StartTime": 1616444937.1010628, "EndTime": 1616444937.1010714, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863679405381945, "count": 1, "min": 0.6863679405381945, "max": 0.6863679405381945}}} #metrics {"StartTime": 1616444937.101105, "EndTime": 1616444937.101113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847766559516059, "count": 1, "min": 0.6847766559516059, "max": 0.6847766559516059}}} #metrics {"StartTime": 1616444937.1011448, "EndTime": 1616444937.1011527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863679850260417, "count": 1, "min": 0.6863679850260417, "max": 0.6863679850260417}}} [03/22/2021 20:28:57 INFO 139804890085184] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.15488599800957573 [2021-03-22 20:28:58.100] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 29, "duration": 986, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444938.7513, "EndTime": 1616444938.7513752, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15581602868362165, "count": 1, "min": 0.15581602868362165, "max": 0.15581602868362165}}} #metrics {"StartTime": 1616444938.7514453, "EndTime": 1616444938.7514555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14249036463097475, "count": 1, "min": 0.14249036463097475, "max": 0.14249036463097475}}} #metrics {"StartTime": 1616444938.751488, "EndTime": 1616444938.7514951, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15740540994911809, "count": 1, "min": 0.15740540994911809, "max": 0.15740540994911809}}} #metrics {"StartTime": 1616444938.7515283, "EndTime": 1616444938.7515364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14272689819335938, "count": 1, "min": 0.14272689819335938, "max": 0.14272689819335938}}} #metrics {"StartTime": 1616444938.7515702, "EndTime": 1616444938.75158, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14021105729922434, "count": 1, "min": 0.14021105729922434, "max": 0.14021105729922434}}} #metrics {"StartTime": 1616444938.7516117, "EndTime": 1616444938.7516215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1420549969608022, "count": 1, "min": 0.1420549969608022, "max": 0.1420549969608022}}} #metrics {"StartTime": 1616444938.751654, "EndTime": 1616444938.7516656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1402101152984094, "count": 1, "min": 0.1402101152984094, "max": 0.1402101152984094}}} #metrics {"StartTime": 1616444938.751697, "EndTime": 1616444938.751707, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.142054338169284, "count": 1, "min": 0.142054338169284, "max": 0.142054338169284}}} #metrics {"StartTime": 1616444938.7517307, "EndTime": 1616444938.7517388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17569219410916434, "count": 1, "min": 0.17569219410916434, "max": 0.17569219410916434}}} #metrics {"StartTime": 1616444938.7517707, "EndTime": 1616444938.7517803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17416633151198016, "count": 1, "min": 0.17416633151198016, "max": 0.17416633151198016}}} #metrics {"StartTime": 1616444938.7518065, "EndTime": 1616444938.751816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17530722530974718, "count": 1, "min": 0.17530722530974718, "max": 0.17530722530974718}}} #metrics {"StartTime": 1616444938.7518508, "EndTime": 1616444938.7518575, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17417363134157113, "count": 1, "min": 0.17417363134157113, "max": 0.17417363134157113}}} #metrics {"StartTime": 1616444938.7518854, "EndTime": 1616444938.7518935, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17435472402797642, "count": 1, "min": 0.17435472402797642, "max": 0.17435472402797642}}} #metrics {"StartTime": 1616444938.751924, "EndTime": 1616444938.7519321, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17534887338543226, "count": 1, "min": 0.17534887338543226, "max": 0.17534887338543226}}} #metrics {"StartTime": 1616444938.7519622, "EndTime": 1616444938.75197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743533800526758, "count": 1, "min": 0.1743533800526758, "max": 0.1743533800526758}}} #metrics {"StartTime": 1616444938.7520025, "EndTime": 1616444938.7520115, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17532477535337807, "count": 1, "min": 0.17532477535337807, "max": 0.17532477535337807}}} #metrics {"StartTime": 1616444938.7520475, "EndTime": 1616444938.7520573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44887902769231197, "count": 1, "min": 0.44887902769231197, "max": 0.44887902769231197}}} #metrics {"StartTime": 1616444938.7520883, "EndTime": 1616444938.7520974, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498253622523686, "count": 1, "min": 0.4498253622523686, "max": 0.4498253622523686}}} #metrics {"StartTime": 1616444938.752131, "EndTime": 1616444938.7521403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4490441117109888, "count": 1, "min": 0.4490441117109888, "max": 0.4490441117109888}}} #metrics {"StartTime": 1616444938.752174, "EndTime": 1616444938.7521834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498376055560637, "count": 1, "min": 0.4498376055560637, "max": 0.4498376055560637}}} #metrics {"StartTime": 1616444938.7522209, "EndTime": 1616444938.7522311, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44940098493006586, "count": 1, "min": 0.44940098493006586, "max": 0.44940098493006586}}} #metrics {"StartTime": 1616444938.7522717, "EndTime": 1616444938.7522812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45017598253500174, "count": 1, "min": 0.45017598253500174, "max": 0.45017598253500174}}} #metrics {"StartTime": 1616444938.7523205, "EndTime": 1616444938.752331, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4494024515278863, "count": 1, "min": 0.4494024515278863, "max": 0.4494024515278863}}} #metrics {"StartTime": 1616444938.7523715, "EndTime": 1616444938.7523823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45017687581163657, "count": 1, "min": 0.45017687581163657, "max": 0.45017687581163657}}} #metrics {"StartTime": 1616444938.7524123, "EndTime": 1616444938.7524207, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847849119253059, "count": 1, "min": 0.6847849119253059, "max": 0.6847849119253059}}} #metrics {"StartTime": 1616444938.752442, "EndTime": 1616444938.7524471, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852066026504569, "count": 1, "min": 0.6852066026504569, "max": 0.6852066026504569}}} #metrics {"StartTime": 1616444938.7524664, "EndTime": 1616444938.752472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847711256892415, "count": 1, "min": 0.6847711256892415, "max": 0.6847711256892415}}} #metrics {"StartTime": 1616444938.7525027, "EndTime": 1616444938.7525117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853439710020532, "count": 1, "min": 0.6853439710020532, "max": 0.6853439710020532}}} #metrics {"StartTime": 1616444938.7525375, "EndTime": 1616444938.7525456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843205972874188, "count": 1, "min": 0.6843205972874188, "max": 0.6843205972874188}}} #metrics {"StartTime": 1616444938.7525785, "EndTime": 1616444938.7525878, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402257129236, "count": 1, "min": 0.6837402257129236, "max": 0.6837402257129236}}} #metrics {"StartTime": 1616444938.7526217, "EndTime": 1616444938.7526305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843825389841082, "count": 1, "min": 0.6843825389841082, "max": 0.6843825389841082}}} #metrics {"StartTime": 1616444938.7526681, "EndTime": 1616444938.7526782, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837402657750271, "count": 1, "min": 0.6837402657750271, "max": 0.6837402657750271}}} [03/22/2021 20:28:58 INFO 139804890085184] #quality_metric: host=algo-1, epoch=9, validation binary_classification_cross_entropy_objective <loss>=0.15581602868362165 [03/22/2021 20:28:58 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:28:58 INFO 139804890085184] Epoch 9: Loss improved. Updating best model [03/22/2021 20:28:58 INFO 139804890085184] Saving model for epoch: 9 [03/22/2021 20:28:58 INFO 139804890085184] Saved checkpoint to "/tmp/tmpaehvgt4h/mx-mod-0000.params" [03/22/2021 20:28:58 INFO 139804890085184] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs #metrics {"StartTime": 1616444927.0531187, "EndTime": 1616444938.758799, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4521610.0, "count": 1, "min": 4521610, "max": 4521610}, "Total Batches Seen": {"sum": 4522.0, "count": 1, "min": 4522, "max": 4522}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:28:58 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38524.590713118814 records/second [2021-03-22 20:29:09.610] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 23, "duration": 10848, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444949.6103754, "EndTime": 1616444949.6104574, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15461682234022353, "count": 1, "min": 0.15461682234022353, "max": 0.15461682234022353}}} #metrics {"StartTime": 1616444949.6105785, "EndTime": 1616444949.6105945, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1407611900668674, "count": 1, "min": 0.1407611900668674, "max": 0.1407611900668674}}} #metrics {"StartTime": 1616444949.610802, "EndTime": 1616444949.610825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1561150203789605, "count": 1, "min": 0.1561150203789605, "max": 0.1561150203789605}}} #metrics {"StartTime": 1616444949.6108735, "EndTime": 1616444949.6108844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14099027862548827, "count": 1, "min": 0.14099027862548827, "max": 0.14099027862548827}}} #metrics {"StartTime": 1616444949.6109252, "EndTime": 1616444949.6109352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384499381679959, "count": 1, "min": 0.1384499381679959, "max": 0.1384499381679959}}} #metrics {"StartTime": 1616444949.6109684, "EndTime": 1616444949.6109786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14113318942599826, "count": 1, "min": 0.14113318942599826, "max": 0.14113318942599826}}} #metrics {"StartTime": 1616444949.6110158, "EndTime": 1616444949.6110253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13844874145507813, "count": 1, "min": 0.13844874145507813, "max": 0.13844874145507813}}} #metrics {"StartTime": 1616444949.611063, "EndTime": 1616444949.611073, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14113317445543078, "count": 1, "min": 0.14113317445543078, "max": 0.14113317445543078}}} #metrics {"StartTime": 1616444949.611113, "EndTime": 1616444949.6111236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17467522837320965, "count": 1, "min": 0.17467522837320965, "max": 0.17467522837320965}}} #metrics {"StartTime": 1616444949.6111622, "EndTime": 1616444949.6111722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336875715467664, "count": 1, "min": 0.17336875715467664, "max": 0.17336875715467664}}} #metrics {"StartTime": 1616444949.611209, "EndTime": 1616444949.6112196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17425065568712023, "count": 1, "min": 0.17425065568712023, "max": 0.17425065568712023}}} #metrics {"StartTime": 1616444949.6112456, "EndTime": 1616444949.6112542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336943912082248, "count": 1, "min": 0.17336943912082248, "max": 0.17336943912082248}}} #metrics {"StartTime": 1616444949.6112897, "EndTime": 1616444949.6112995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17326278761121963, "count": 1, "min": 0.17326278761121963, "max": 0.17326278761121963}}} #metrics {"StartTime": 1616444949.6113436, "EndTime": 1616444949.6113544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1751716810099284, "count": 1, "min": 0.1751716810099284, "max": 0.1751716810099284}}} #metrics {"StartTime": 1616444949.611386, "EndTime": 1616444949.611396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732626835123698, "count": 1, "min": 0.1732626835123698, "max": 0.1732626835123698}}} #metrics {"StartTime": 1616444949.6114326, "EndTime": 1616444949.6114423, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17517204718695747, "count": 1, "min": 0.17517204718695747, "max": 0.17517204718695747}}} #metrics {"StartTime": 1616444949.6114686, "EndTime": 1616444949.6114779, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476756686062283, "count": 1, "min": 0.4476756686062283, "max": 0.4476756686062283}}} #metrics {"StartTime": 1616444949.611513, "EndTime": 1616444949.6115227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777454800075955, "count": 1, "min": 0.44777454800075955, "max": 0.44777454800075955}}} #metrics {"StartTime": 1616444949.6115603, "EndTime": 1616444949.611569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476794705539279, "count": 1, "min": 0.4476794705539279, "max": 0.4476794705539279}}} #metrics {"StartTime": 1616444949.6116524, "EndTime": 1616444949.6116607, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477745386420356, "count": 1, "min": 0.4477745386420356, "max": 0.4477745386420356}}} #metrics {"StartTime": 1616444949.611682, "EndTime": 1616444949.6116874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44771400465223526, "count": 1, "min": 0.44771400465223526, "max": 0.44771400465223526}}} #metrics {"StartTime": 1616444949.6117067, "EndTime": 1616444949.6117122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487335166422526, "count": 1, "min": 0.4487335166422526, "max": 0.4487335166422526}}} #metrics {"StartTime": 1616444949.6117406, "EndTime": 1616444949.6117468, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477140277777778, "count": 1, "min": 0.4477140277777778, "max": 0.4477140277777778}}} #metrics {"StartTime": 1616444949.6117668, "EndTime": 1616444949.611772, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4487335036892361, "count": 1, "min": 0.4487335036892361, "max": 0.4487335036892361}}} #metrics {"StartTime": 1616444949.6118, "EndTime": 1616444949.611808, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847294425455729, "count": 1, "min": 0.6847294425455729, "max": 0.6847294425455729}}} #metrics {"StartTime": 1616444949.6118288, "EndTime": 1616444949.6118338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848382775878906, "count": 1, "min": 0.6848382775878906, "max": 0.6848382775878906}}} #metrics {"StartTime": 1616444949.611853, "EndTime": 1616444949.6118577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320256890191, "count": 1, "min": 0.6847320256890191, "max": 0.6847320256890191}}} #metrics {"StartTime": 1616444949.6118762, "EndTime": 1616444949.6118813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684838296983507, "count": 1, "min": 0.684838296983507, "max": 0.684838296983507}}} #metrics {"StartTime": 1616444949.6118996, "EndTime": 1616444949.6119046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847614286295572, "count": 1, "min": 0.6847614286295572, "max": 0.6847614286295572}}} #metrics {"StartTime": 1616444949.6119235, "EndTime": 1616444949.6119282, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863115861002604, "count": 1, "min": 0.6863115861002604, "max": 0.6863115861002604}}} #metrics {"StartTime": 1616444949.6119535, "EndTime": 1616444949.611959, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847616261121962, "count": 1, "min": 0.6847616261121962, "max": 0.6847616261121962}}} #metrics {"StartTime": 1616444949.611978, "EndTime": 1616444949.6119828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863116219075521, "count": 1, "min": 0.6863116219075521, "max": 0.6863116219075521}}} [03/22/2021 20:29:09 INFO 139804890085184] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.15461682234022353 [2021-03-22 20:29:10.590] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 32, "duration": 964, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444951.2596905, "EndTime": 1616444951.2597506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1556023771466358, "count": 1, "min": 0.1556023771466358, "max": 0.1556023771466358}}} #metrics {"StartTime": 1616444951.2598193, "EndTime": 1616444951.2598293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14202364166514214, "count": 1, "min": 0.14202364166514214, "max": 0.14202364166514214}}} #metrics {"StartTime": 1616444951.2598565, "EndTime": 1616444951.2598648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15687450627517632, "count": 1, "min": 0.15687450627517632, "max": 0.15687450627517632}}} #metrics {"StartTime": 1616444951.2598991, "EndTime": 1616444951.2599072, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14222043659832115, "count": 1, "min": 0.14222043659832115, "max": 0.14222043659832115}}} #metrics {"StartTime": 1616444951.2599423, "EndTime": 1616444951.259951, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14015598415545968, "count": 1, "min": 0.14015598415545968, "max": 0.14015598415545968}}} #metrics {"StartTime": 1616444951.2599823, "EndTime": 1616444951.2599905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14172558049392633, "count": 1, "min": 0.14172558049392633, "max": 0.14172558049392633}}} #metrics {"StartTime": 1616444951.2600253, "EndTime": 1616444951.2600346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14015505406499987, "count": 1, "min": 0.14015505406499987, "max": 0.14015505406499987}}} #metrics {"StartTime": 1616444951.2600722, "EndTime": 1616444951.2600818, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14172507816116417, "count": 1, "min": 0.14172507816116417, "max": 0.14172507816116417}}} #metrics {"StartTime": 1616444951.2601187, "EndTime": 1616444951.2601283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17559406171564898, "count": 1, "min": 0.17559406171564898, "max": 0.17559406171564898}}} #metrics {"StartTime": 1616444951.2601674, "EndTime": 1616444951.2601757, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741773952844825, "count": 1, "min": 0.1741773952844825, "max": 0.1741773952844825}}} #metrics {"StartTime": 1616444951.2602036, "EndTime": 1616444951.2602112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17514242605683397, "count": 1, "min": 0.17514242605683397, "max": 0.17514242605683397}}} #metrics {"StartTime": 1616444951.2602453, "EndTime": 1616444951.2602553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1741844130552088, "count": 1, "min": 0.1741844130552088, "max": 0.1741844130552088}}} #metrics {"StartTime": 1616444951.2602906, "EndTime": 1616444951.2603006, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433640786428622, "count": 1, "min": 0.17433640786428622, "max": 0.17433640786428622}}} #metrics {"StartTime": 1616444951.2603312, "EndTime": 1616444951.26034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17602182428570784, "count": 1, "min": 0.17602182428570784, "max": 0.17602182428570784}}} #metrics {"StartTime": 1616444951.2603693, "EndTime": 1616444951.2603776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17433563017223414, "count": 1, "min": 0.17433563017223414, "max": 0.17433563017223414}}} #metrics {"StartTime": 1616444951.2604089, "EndTime": 1616444951.2604175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1760061859894205, "count": 1, "min": 0.1760061859894205, "max": 0.1760061859894205}}} #metrics {"StartTime": 1616444951.2604508, "EndTime": 1616444951.2604604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44883367657894063, "count": 1, "min": 0.44883367657894063, "max": 0.44883367657894063}}} #metrics {"StartTime": 1616444951.2604964, "EndTime": 1616444951.260506, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44992523518187244, "count": 1, "min": 0.44992523518187244, "max": 0.44992523518187244}}} #metrics {"StartTime": 1616444951.2605414, "EndTime": 1616444951.2605507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44905520160506546, "count": 1, "min": 0.44905520160506546, "max": 0.44905520160506546}}} #metrics {"StartTime": 1616444951.2605855, "EndTime": 1616444951.2605948, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44993462081240576, "count": 1, "min": 0.44993462081240576, "max": 0.44993462081240576}}} #metrics {"StartTime": 1616444951.2606285, "EndTime": 1616444951.2606375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493922346087028, "count": 1, "min": 0.4493922346087028, "max": 0.4493922346087028}}} #metrics {"StartTime": 1616444951.2606702, "EndTime": 1616444951.2606792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506329062561501, "count": 1, "min": 0.4506329062561501, "max": 0.4506329062561501}}} #metrics {"StartTime": 1616444951.26071, "EndTime": 1616444951.2607186, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4493911366905116, "count": 1, "min": 0.4493911366905116, "max": 0.4493911366905116}}} #metrics {"StartTime": 1616444951.2607543, "EndTime": 1616444951.2607641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45063324245299263, "count": 1, "min": 0.45063324245299263, "max": 0.45063324245299263}}} #metrics {"StartTime": 1616444951.2607923, "EndTime": 1616444951.2608016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847834307102314, "count": 1, "min": 0.6847834307102314, "max": 0.6847834307102314}}} #metrics {"StartTime": 1616444951.2608402, "EndTime": 1616444951.2608511, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6853916993140329, "count": 1, "min": 0.6853916993140329, "max": 0.6853916993140329}}} #metrics {"StartTime": 1616444951.2608955, "EndTime": 1616444951.2609046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847851003254689, "count": 1, "min": 0.6847851003254689, "max": 0.6847851003254689}}} #metrics {"StartTime": 1616444951.2609365, "EndTime": 1616444951.2609463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855036528626084, "count": 1, "min": 0.6855036528626084, "max": 0.6855036528626084}}} #metrics {"StartTime": 1616444951.26098, "EndTime": 1616444951.260989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844979819960473, "count": 1, "min": 0.6844979819960473, "max": 0.6844979819960473}}} #metrics {"StartTime": 1616444951.261027, "EndTime": 1616444951.2610376, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848288798133426, "count": 1, "min": 0.6848288798133426, "max": 0.6848288798133426}}} #metrics {"StartTime": 1616444951.261075, "EndTime": 1616444951.2610846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845233253369375, "count": 1, "min": 0.6845233253369375, "max": 0.6845233253369375}}} #metrics {"StartTime": 1616444951.2611206, "EndTime": 1616444951.261129, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848288657374684, "count": 1, "min": 0.6848288657374684, "max": 0.6848288657374684}}} [03/22/2021 20:29:11 INFO 139804890085184] #quality_metric: host=algo-1, epoch=10, validation binary_classification_cross_entropy_objective <loss>=0.1556023771466358 [03/22/2021 20:29:11 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=sampled_accuracy, value=0.9504878481461771 [03/22/2021 20:29:11 INFO 139804890085184] Epoch 10: Loss improved. Updating best model [03/22/2021 20:29:11 INFO 139804890085184] Saving model for epoch: 10 [03/22/2021 20:29:11 INFO 139804890085184] Saved checkpoint to "/tmp/tmp5tljyarr/mx-mod-0000.params" [03/22/2021 20:29:11 INFO 139804890085184] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs #metrics {"StartTime": 1616444938.7618065, "EndTime": 1616444951.2666943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4972571.0, "count": 1, "min": 4972571, "max": 4972571}, "Total Batches Seen": {"sum": 4973.0, "count": 1, "min": 4973, "max": 4973}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:29:11 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=36062.453312839825 records/second [2021-03-22 20:29:21.716] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 25, "duration": 10446, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444961.7163787, "EndTime": 1616444961.7164469, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15443608091566297, "count": 1, "min": 0.15443608091566297, "max": 0.15443608091566297}}} #metrics {"StartTime": 1616444961.7165213, "EndTime": 1616444961.716535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1403178591410319, "count": 1, "min": 0.1403178591410319, "max": 0.1403178591410319}}} #metrics {"StartTime": 1616444961.7165635, "EndTime": 1616444961.7165697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15556796028984918, "count": 1, "min": 0.15556796028984918, "max": 0.15556796028984918}}} #metrics {"StartTime": 1616444961.7165926, "EndTime": 1616444961.716601, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14050594197591146, "count": 1, "min": 0.14050594197591146, "max": 0.14050594197591146}}} #metrics {"StartTime": 1616444961.7166283, "EndTime": 1616444961.7166343, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1384271457417806, "count": 1, "min": 0.1384271457417806, "max": 0.1384271457417806}}} #metrics {"StartTime": 1616444961.716664, "EndTime": 1616444961.7166705, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102241249932182, "count": 1, "min": 0.14102241249932182, "max": 0.14102241249932182}}} #metrics {"StartTime": 1616444961.716691, "EndTime": 1616444961.716696, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13842593938191733, "count": 1, "min": 0.13842593938191733, "max": 0.13842593938191733}}} #metrics {"StartTime": 1616444961.7167175, "EndTime": 1616444961.7167253, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14102239615546333, "count": 1, "min": 0.14102239615546333, "max": 0.14102239615546333}}} #metrics {"StartTime": 1616444961.716748, "EndTime": 1616444961.7167532, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17459287841796875, "count": 1, "min": 0.17459287841796875, "max": 0.17459287841796875}}} #metrics {"StartTime": 1616444961.7167723, "EndTime": 1616444961.7167773, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336395992702908, "count": 1, "min": 0.17336395992702908, "max": 0.17336395992702908}}} #metrics {"StartTime": 1616444961.7167997, "EndTime": 1616444961.7168074, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17408617824978298, "count": 1, "min": 0.17408617824978298, "max": 0.17408617824978298}}} #metrics {"StartTime": 1616444961.7168279, "EndTime": 1616444961.716833, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17336453158908421, "count": 1, "min": 0.17336453158908421, "max": 0.17336453158908421}}} #metrics {"StartTime": 1616444961.716852, "EndTime": 1616444961.7168705, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17324363813612195, "count": 1, "min": 0.17324363813612195, "max": 0.17324363813612195}}} #metrics {"StartTime": 1616444961.7168944, "EndTime": 1616444961.7169027, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514980526394314, "count": 1, "min": 0.17514980526394314, "max": 0.17514980526394314}}} #metrics {"StartTime": 1616444961.7169342, "EndTime": 1616444961.7169428, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732435801188151, "count": 1, "min": 0.1732435801188151, "max": 0.1732435801188151}}} #metrics {"StartTime": 1616444961.7169778, "EndTime": 1616444961.716988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17514994951036242, "count": 1, "min": 0.17514994951036242, "max": 0.17514994951036242}}} #metrics {"StartTime": 1616444961.7170246, "EndTime": 1616444961.717034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476709446885851, "count": 1, "min": 0.4476709446885851, "max": 0.4476709446885851}}} #metrics {"StartTime": 1616444961.7170713, "EndTime": 1616444961.717081, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477706784396701, "count": 1, "min": 0.4477706784396701, "max": 0.4477706784396701}}} #metrics {"StartTime": 1616444961.717121, "EndTime": 1616444961.7171304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795026991102, "count": 1, "min": 0.4476795026991102, "max": 0.4476795026991102}}} #metrics {"StartTime": 1616444961.7171686, "EndTime": 1616444961.7171786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44777066467285154, "count": 1, "min": 0.44777066467285154, "max": 0.44777066467285154}}} #metrics {"StartTime": 1616444961.7172184, "EndTime": 1616444961.7172282, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476882718234592, "count": 1, "min": 0.4476882718234592, "max": 0.4476882718234592}}} #metrics {"StartTime": 1616444961.7172685, "EndTime": 1616444961.7172787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486791339111328, "count": 1, "min": 0.4486791339111328, "max": 0.4486791339111328}}} #metrics {"StartTime": 1616444961.7173207, "EndTime": 1616444961.7173316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476882923719618, "count": 1, "min": 0.4476882923719618, "max": 0.4476882923719618}}} #metrics {"StartTime": 1616444961.7173724, "EndTime": 1616444961.7173822, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4486791289605035, "count": 1, "min": 0.4486791289605035, "max": 0.4486791289605035}}} #metrics {"StartTime": 1616444961.7174146, "EndTime": 1616444961.7174237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847284860568577, "count": 1, "min": 0.6847284860568577, "max": 0.6847284860568577}}} #metrics {"StartTime": 1616444961.7174563, "EndTime": 1616444961.7174642, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684834837375217, "count": 1, "min": 0.684834837375217, "max": 0.684834837375217}}} #metrics {"StartTime": 1616444961.717496, "EndTime": 1616444961.7175045, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847320674641927, "count": 1, "min": 0.6847320674641927, "max": 0.6847320674641927}}} #metrics {"StartTime": 1616444961.7175362, "EndTime": 1616444961.717544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848352323404948, "count": 1, "min": 0.6848352323404948, "max": 0.6848352323404948}}} #metrics {"StartTime": 1616444961.7175734, "EndTime": 1616444961.7175827, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847499201117622, "count": 1, "min": 0.6847499201117622, "max": 0.6847499201117622}}} #metrics {"StartTime": 1616444961.7176168, "EndTime": 1616444961.7176259, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657495117187, "count": 1, "min": 0.6862657495117187, "max": 0.6862657495117187}}} #metrics {"StartTime": 1616444961.7176585, "EndTime": 1616444961.717667, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847497003851997, "count": 1, "min": 0.6847497003851997, "max": 0.6847497003851997}}} #metrics {"StartTime": 1616444961.7176993, "EndTime": 1616444961.7177072, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862657683648004, "count": 1, "min": 0.6862657683648004, "max": 0.6862657683648004}}} [03/22/2021 20:29:21 INFO 139804890085184] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.15443608091566297 [2021-03-22 20:29:22.679] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 35, "duration": 948, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444963.3891647, "EndTime": 1616444963.3892267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15545974103444768, "count": 1, "min": 0.15545974103444768, "max": 0.15545974103444768}}} #metrics {"StartTime": 1616444963.3893049, "EndTime": 1616444963.3893166, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1416547966443289, "count": 1, "min": 0.1416547966443289, "max": 0.1416547966443289}}} #metrics {"StartTime": 1616444963.3893497, "EndTime": 1616444963.3893588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15633698220326583, "count": 1, "min": 0.15633698220326583, "max": 0.15633698220326583}}} #metrics {"StartTime": 1616444963.389393, "EndTime": 1616444963.389403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14181766763781536, "count": 1, "min": 0.14181766763781536, "max": 0.14181766763781536}}} #metrics {"StartTime": 1616444963.38943, "EndTime": 1616444963.3894396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14012784086602662, "count": 1, "min": 0.14012784086602662, "max": 0.14012784086602662}}} #metrics {"StartTime": 1616444963.3894694, "EndTime": 1616444963.3894806, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14143996422270078, "count": 1, "min": 0.14143996422270078, "max": 0.14143996422270078}}} #metrics {"StartTime": 1616444963.389514, "EndTime": 1616444963.389524, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14012672196936898, "count": 1, "min": 0.14012672196936898, "max": 0.14012672196936898}}} #metrics {"StartTime": 1616444963.389553, "EndTime": 1616444963.3895626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414396547564848, "count": 1, "min": 0.1414396547564848, "max": 0.1414396547564848}}} #metrics {"StartTime": 1616444963.389591, "EndTime": 1616444963.3895993, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17552629260702168, "count": 1, "min": 0.17552629260702168, "max": 0.17552629260702168}}} #metrics {"StartTime": 1616444963.3896296, "EndTime": 1616444963.3896382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17419045573328115, "count": 1, "min": 0.17419045573328115, "max": 0.17419045573328115}}} #metrics {"StartTime": 1616444963.38967, "EndTime": 1616444963.389679, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17498462508497498, "count": 1, "min": 0.17498462508497498, "max": 0.17498462508497498}}} #metrics {"StartTime": 1616444963.3897123, "EndTime": 1616444963.3897214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17419672017404536, "count": 1, "min": 0.17419672017404536, "max": 0.17419672017404536}}} #metrics {"StartTime": 1616444963.3897595, "EndTime": 1616444963.389769, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427781656402971, "count": 1, "min": 0.17427781656402971, "max": 0.17427781656402971}}} #metrics {"StartTime": 1616444963.3897989, "EndTime": 1616444963.3898077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1765536573733847, "count": 1, "min": 0.1765536573733847, "max": 0.1765536573733847}}} #metrics {"StartTime": 1616444963.3898396, "EndTime": 1616444963.389849, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17427748842021137, "count": 1, "min": 0.17427748842021137, "max": 0.17427748842021137}}} #metrics {"StartTime": 1616444963.3898807, "EndTime": 1616444963.38989, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17654698757451118, "count": 1, "min": 0.17654698757451118, "max": 0.17654698757451118}}} #metrics {"StartTime": 1616444963.3899224, "EndTime": 1616444963.3899314, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4488074372545168, "count": 1, "min": 0.4488074372545168, "max": 0.4488074372545168}}} #metrics {"StartTime": 1616444963.3899648, "EndTime": 1616444963.3899734, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500131078872017, "count": 1, "min": 0.4500131078872017, "max": 0.4500131078872017}}} #metrics {"StartTime": 1616444963.390011, "EndTime": 1616444963.390021, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44906298475145384, "count": 1, "min": 0.44906298475145384, "max": 0.44906298475145384}}} #metrics {"StartTime": 1616444963.3900533, "EndTime": 1616444963.3900626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4500199254827548, "count": 1, "min": 0.4500199254827548, "max": 0.4500199254827548}}} #metrics {"StartTime": 1616444963.3900957, "EndTime": 1616444963.3901043, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44980804405462793, "count": 1, "min": 0.44980804405462793, "max": 0.44980804405462793}}} #metrics {"StartTime": 1616444963.3901346, "EndTime": 1616444963.3901434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45081716351037926, "count": 1, "min": 0.45081716351037926, "max": 0.45081716351037926}}} #metrics {"StartTime": 1616444963.390177, "EndTime": 1616444963.3901865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4498077944785499, "count": 1, "min": 0.4498077944785499, "max": 0.4498077944785499}}} #metrics {"StartTime": 1616444963.390219, "EndTime": 1616444963.3902278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.450817266913917, "count": 1, "min": 0.450817266913917, "max": 0.450817266913917}}} #metrics {"StartTime": 1616444963.390259, "EndTime": 1616444963.3902686, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847868725321744, "count": 1, "min": 0.6847868725321744, "max": 0.6847868725321744}}} #metrics {"StartTime": 1616444963.3903027, "EndTime": 1616444963.3903124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.685490803213561, "count": 1, "min": 0.685490803213561, "max": 0.685490803213561}}} #metrics {"StartTime": 1616444963.3903477, "EndTime": 1616444963.3903577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848020013900901, "count": 1, "min": 0.6848020013900901, "max": 0.6848020013900901}}} #metrics {"StartTime": 1616444963.3903854, "EndTime": 1616444963.390395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856148170794666, "count": 1, "min": 0.6856148170794666, "max": 0.6856148170794666}}} #metrics {"StartTime": 1616444963.3904269, "EndTime": 1616444963.3904362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845315231802364, "count": 1, "min": 0.6845315231802364, "max": 0.6845315231802364}}} #metrics {"StartTime": 1616444963.390469, "EndTime": 1616444963.3904784, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849503957529492, "count": 1, "min": 0.6849503957529492, "max": 0.6849503957529492}}} #metrics {"StartTime": 1616444963.3905108, "EndTime": 1616444963.3905196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845795451907458, "count": 1, "min": 0.6845795451907458, "max": 0.6845795451907458}}} #metrics {"StartTime": 1616444963.390553, "EndTime": 1616444963.3905613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6849503960236392, "count": 1, "min": 0.6849503960236392, "max": 0.6849503960236392}}} [03/22/2021 20:29:23 INFO 139804890085184] #quality_metric: host=algo-1, epoch=11, validation binary_classification_cross_entropy_objective <loss>=0.15545974103444768 [03/22/2021 20:29:23 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=sampled_accuracy, value=0.9505055880787654 [03/22/2021 20:29:23 INFO 139804890085184] Epoch 11: Loss improved. Updating best model [03/22/2021 20:29:23 INFO 139804890085184] Saving model for epoch: 11 [03/22/2021 20:29:23 INFO 139804890085184] Saved checkpoint to "/tmp/tmp2f393_x2/mx-mod-0000.params" [03/22/2021 20:29:23 INFO 139804890085184] #progress_metric: host=algo-1, completed 80.0 % of epochs #metrics {"StartTime": 1616444951.2695804, "EndTime": 1616444963.3960965, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5423532.0, "count": 1, "min": 5423532, "max": 5423532}, "Total Batches Seen": {"sum": 5424.0, "count": 1, "min": 5424, "max": 5424}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:29:23 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=37187.680078146 records/second [2021-03-22 20:29:33.339] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 27, "duration": 9940, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444973.339748, "EndTime": 1616444973.3398128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15431584630330403, "count": 1, "min": 0.15431584630330403, "max": 0.15431584630330403}}} #metrics {"StartTime": 1616444973.3398833, "EndTime": 1616444973.339893, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13996640984429254, "count": 1, "min": 0.13996640984429254, "max": 0.13996640984429254}}} #metrics {"StartTime": 1616444973.3399222, "EndTime": 1616444973.339929, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15501876495361328, "count": 1, "min": 0.15501876495361328, "max": 0.15501876495361328}}} #metrics {"StartTime": 1616444973.3399549, "EndTime": 1616444973.339961, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14012161241319446, "count": 1, "min": 0.14012161241319446, "max": 0.14012161241319446}}} #metrics {"StartTime": 1616444973.3399858, "EndTime": 1616444973.339992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13841161219278972, "count": 1, "min": 0.13841161219278972, "max": 0.13841161219278972}}} #metrics {"StartTime": 1616444973.3400161, "EndTime": 1616444973.340022, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1409181515842014, "count": 1, "min": 0.1409181515842014, "max": 0.1409181515842014}}} #metrics {"StartTime": 1616444973.3400462, "EndTime": 1616444973.3400521, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13841047926161024, "count": 1, "min": 0.13841047926161024, "max": 0.13841047926161024}}} #metrics {"StartTime": 1616444973.340076, "EndTime": 1616444973.3400817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1409181286960178, "count": 1, "min": 0.1409181286960178, "max": 0.1409181286960178}}} #metrics {"StartTime": 1616444973.3401053, "EndTime": 1616444973.340111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17453608371310764, "count": 1, "min": 0.17453608371310764, "max": 0.17453608371310764}}} #metrics {"StartTime": 1616444973.3401344, "EndTime": 1616444973.3401403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733587730577257, "count": 1, "min": 0.1733587730577257, "max": 0.1733587730577257}}} #metrics {"StartTime": 1616444973.3401635, "EndTime": 1616444973.3401694, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1739323609076606, "count": 1, "min": 0.1739323609076606, "max": 0.1739323609076606}}} #metrics {"StartTime": 1616444973.3401957, "EndTime": 1616444973.3402016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733595228407118, "count": 1, "min": 0.1733595228407118, "max": 0.1733595228407118}}} #metrics {"StartTime": 1616444973.3402307, "EndTime": 1616444973.3402388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17322929195827907, "count": 1, "min": 0.17322929195827907, "max": 0.17322929195827907}}} #metrics {"StartTime": 1616444973.340266, "EndTime": 1616444973.3402724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510965799967448, "count": 1, "min": 0.17510965799967448, "max": 0.17510965799967448}}} #metrics {"StartTime": 1616444973.3402994, "EndTime": 1616444973.3403053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17322924855550131, "count": 1, "min": 0.17322924855550131, "max": 0.17322924855550131}}} #metrics {"StartTime": 1616444973.340332, "EndTime": 1616444973.3403382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17510990414089628, "count": 1, "min": 0.17510990414089628, "max": 0.17510990414089628}}} #metrics {"StartTime": 1616444973.3403623, "EndTime": 1616444973.340368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476702345106337, "count": 1, "min": 0.4476702345106337, "max": 0.4476702345106337}}} #metrics {"StartTime": 1616444973.3403943, "EndTime": 1616444973.3404005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654585096571, "count": 1, "min": 0.4477654585096571, "max": 0.4477654585096571}}} #metrics {"StartTime": 1616444973.3404245, "EndTime": 1616444973.3404303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767952426486546, "count": 1, "min": 0.44767952426486546, "max": 0.44767952426486546}}} #metrics {"StartTime": 1616444973.3404539, "EndTime": 1616444973.34046, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477654515245226, "count": 1, "min": 0.4477654515245226, "max": 0.4477654515245226}}} #metrics {"StartTime": 1616444973.3404858, "EndTime": 1616444973.340492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795998128255, "count": 1, "min": 0.4476795998128255, "max": 0.4476795998128255}}} #metrics {"StartTime": 1616444973.3405175, "EndTime": 1616444973.3405237, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44864054545084636, "count": 1, "min": 0.44864054545084636, "max": 0.44864054545084636}}} #metrics {"StartTime": 1616444973.3405478, "EndTime": 1616444973.3405538, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795876736111, "count": 1, "min": 0.4476795876736111, "max": 0.4476795876736111}}} #metrics {"StartTime": 1616444973.3405793, "EndTime": 1616444973.3405855, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44864054144965276, "count": 1, "min": 0.44864054144965276, "max": 0.44864054144965276}}} #metrics {"StartTime": 1616444973.3406107, "EndTime": 1616444973.340617, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847279055447049, "count": 1, "min": 0.6847279055447049, "max": 0.6847279055447049}}} #metrics {"StartTime": 1616444973.3406405, "EndTime": 1616444973.3406465, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848310275607639, "count": 1, "min": 0.6848310275607639, "max": 0.6848310275607639}}} #metrics {"StartTime": 1616444973.3406696, "EndTime": 1616444973.3406756, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321385362414, "count": 1, "min": 0.6847321385362414, "max": 0.6847321385362414}}} #metrics {"StartTime": 1616444973.340699, "EndTime": 1616444973.3407047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848313465711806, "count": 1, "min": 0.6848313465711806, "max": 0.6848313465711806}}} #metrics {"StartTime": 1616444973.3407283, "EndTime": 1616444973.3407342, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684741653781467, "count": 1, "min": 0.684741653781467, "max": 0.684741653781467}}} #metrics {"StartTime": 1616444973.3407576, "EndTime": 1616444973.3407633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862042358398438, "count": 1, "min": 0.6862042358398438, "max": 0.6862042358398438}}} #metrics {"StartTime": 1616444973.3407867, "EndTime": 1616444973.3407927, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847413389756944, "count": 1, "min": 0.6847413389756944, "max": 0.6847413389756944}}} #metrics {"StartTime": 1616444973.3408175, "EndTime": 1616444973.3408234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686204245469835, "count": 1, "min": 0.686204245469835, "max": 0.686204245469835}}} [03/22/2021 20:29:33 INFO 139804890085184] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.15431584630330403 [2021-03-22 20:29:34.416] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 38, "duration": 1062, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444975.0884936, "EndTime": 1616444975.0885599, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553652796695392, "count": 1, "min": 0.1553652796695392, "max": 0.1553652796695392}}} #metrics {"StartTime": 1616444975.0886312, "EndTime": 1616444975.0886407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14136651732597194, "count": 1, "min": 0.14136651732597194, "max": 0.14136651732597194}}} #metrics {"StartTime": 1616444975.0886748, "EndTime": 1616444975.088683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15580257742629525, "count": 1, "min": 0.15580257742629525, "max": 0.15580257742629525}}} #metrics {"StartTime": 1616444975.088714, "EndTime": 1616444975.0887227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1415008278292334, "count": 1, "min": 0.1415008278292334, "max": 0.1415008278292334}}} #metrics {"StartTime": 1616444975.0887573, "EndTime": 1616444975.0887668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401141726507539, "count": 1, "min": 0.1401141726507539, "max": 0.1401141726507539}}} #metrics {"StartTime": 1616444975.0888023, "EndTime": 1616444975.0888124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113159639860312, "count": 1, "min": 0.14113159639860312, "max": 0.14113159639860312}}} #metrics {"StartTime": 1616444975.0888517, "EndTime": 1616444975.0888736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.140113226927953, "count": 1, "min": 0.140113226927953, "max": 0.140113226927953}}} #metrics {"StartTime": 1616444975.0889077, "EndTime": 1616444975.0889168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1411315157330161, "count": 1, "min": 0.1411315157330161, "max": 0.1411315157330161}}} #metrics {"StartTime": 1616444975.0889516, "EndTime": 1616444975.0889614, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1754797439615799, "count": 1, "min": 0.1754797439615799, "max": 0.1754797439615799}}} #metrics {"StartTime": 1616444975.0889943, "EndTime": 1616444975.0890033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742001686278907, "count": 1, "min": 0.1742001686278907, "max": 0.1742001686278907}}} #metrics {"StartTime": 1616444975.089038, "EndTime": 1616444975.0890465, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17484027191914628, "count": 1, "min": 0.17484027191914628, "max": 0.17484027191914628}}} #metrics {"StartTime": 1616444975.0890853, "EndTime": 1616444975.0890956, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420522525036866, "count": 1, "min": 0.17420522525036866, "max": 0.17420522525036866}}} #metrics {"StartTime": 1616444975.0891387, "EndTime": 1616444975.0891502, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17423933583073992, "count": 1, "min": 0.17423933583073992, "max": 0.17423933583073992}}} #metrics {"StartTime": 1616444975.0891922, "EndTime": 1616444975.089202, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659007030660978, "count": 1, "min": 0.17659007030660978, "max": 0.17659007030660978}}} #metrics {"StartTime": 1616444975.0892425, "EndTime": 1616444975.0892527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17423918207888275, "count": 1, "min": 0.17423918207888275, "max": 0.17423918207888275}}} #metrics {"StartTime": 1616444975.0892925, "EndTime": 1616444975.0893028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17659058583550405, "count": 1, "min": 0.17659058583550405, "max": 0.17659058583550405}}} #metrics {"StartTime": 1616444975.089345, "EndTime": 1616444975.0893552, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487823405121158, "count": 1, "min": 0.4487823405121158, "max": 0.4487823405121158}}} #metrics {"StartTime": 1616444975.0893924, "EndTime": 1616444975.089401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4501426987768975, "count": 1, "min": 0.4501426987768975, "max": 0.4501426987768975}}} #metrics {"StartTime": 1616444975.0894346, "EndTime": 1616444975.0894427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44906828729569626, "count": 1, "min": 0.44906828729569626, "max": 0.44906828729569626}}} #metrics {"StartTime": 1616444975.0894783, "EndTime": 1616444975.0894873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45014732946883457, "count": 1, "min": 0.45014732946883457, "max": 0.45014732946883457}}} #metrics {"StartTime": 1616444975.0895245, "EndTime": 1616444975.089533, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44965558230549135, "count": 1, "min": 0.44965558230549135, "max": 0.44965558230549135}}} #metrics {"StartTime": 1616444975.0895693, "EndTime": 1616444975.0895774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45070067563546723, "count": 1, "min": 0.45070067563546723, "max": 0.45070067563546723}}} #metrics {"StartTime": 1616444975.0896091, "EndTime": 1616444975.089618, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44965586923677403, "count": 1, "min": 0.44965586923677403, "max": 0.44965586923677403}}} #metrics {"StartTime": 1616444975.0896525, "EndTime": 1616444975.089663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4507006512733772, "count": 1, "min": 0.4507006512733772, "max": 0.4507006512733772}}} #metrics {"StartTime": 1616444975.0897026, "EndTime": 1616444975.0897126, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847838096760764, "count": 1, "min": 0.6847838096760764, "max": 0.6847838096760764}}} #metrics {"StartTime": 1616444975.0897508, "EndTime": 1616444975.0897608, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856185163274944, "count": 1, "min": 0.6856185163274944, "max": 0.6856185163274944}}} #metrics {"StartTime": 1616444975.0897982, "EndTime": 1616444975.089808, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174363982705, "count": 1, "min": 0.6848174363982705, "max": 0.6848174363982705}}} #metrics {"StartTime": 1616444975.0898461, "EndTime": 1616444975.089855, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857288706402037, "count": 1, "min": 0.6857288706402037, "max": 0.6857288706402037}}} #metrics {"StartTime": 1616444975.08989, "EndTime": 1616444975.0898995, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846795331634526, "count": 1, "min": 0.6846795331634526, "max": 0.6846795331634526}}} #metrics {"StartTime": 1616444975.0899315, "EndTime": 1616444975.0899382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053046123132, "count": 1, "min": 0.6855053046123132, "max": 0.6855053046123132}}} #metrics {"StartTime": 1616444975.0899608, "EndTime": 1616444975.0899663, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847120378760554, "count": 1, "min": 0.6847120378760554, "max": 0.6847120378760554}}} #metrics {"StartTime": 1616444975.0899935, "EndTime": 1616444975.090001, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855053062364526, "count": 1, "min": 0.6855053062364526, "max": 0.6855053062364526}}} [03/22/2021 20:29:35 INFO 139804890085184] #quality_metric: host=algo-1, epoch=12, validation binary_classification_cross_entropy_objective <loss>=0.1553652796695392 [03/22/2021 20:29:35 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=sampled_accuracy, value=0.9505588078765301 [03/22/2021 20:29:35 INFO 139804890085184] Epoch 12: Loss improved. Updating best model [03/22/2021 20:29:35 INFO 139804890085184] Saving model for epoch: 12 [03/22/2021 20:29:35 INFO 139804890085184] Saved checkpoint to "/tmp/tmpvda0u6gr/mx-mod-0000.params" [03/22/2021 20:29:35 INFO 139804890085184] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs #metrics {"StartTime": 1616444963.3986566, "EndTime": 1616444975.0956185, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5874493.0, "count": 1, "min": 5874493, "max": 5874493}, "Total Batches Seen": {"sum": 5875.0, "count": 1, "min": 5875, "max": 5875}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:29:35 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38553.30290265392 records/second [2021-03-22 20:29:45.005] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 29, "duration": 9907, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444985.0057414, "EndTime": 1616444985.0058184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.154236552734375, "count": 1, "min": 0.154236552734375, "max": 0.154236552734375}}} #metrics {"StartTime": 1616444985.0058908, "EndTime": 1616444985.0059066, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1396803473409017, "count": 1, "min": 0.1396803473409017, "max": 0.1396803473409017}}} #metrics {"StartTime": 1616444985.0059483, "EndTime": 1616444985.0059595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1544760454305013, "count": 1, "min": 0.1544760454305013, "max": 0.1544760454305013}}} #metrics {"StartTime": 1616444985.005999, "EndTime": 1616444985.0060103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13980974134657118, "count": 1, "min": 0.13980974134657118, "max": 0.13980974134657118}}} #metrics {"StartTime": 1616444985.0060506, "EndTime": 1616444985.0060623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13840109159681532, "count": 1, "min": 0.13840109159681532, "max": 0.13840109159681532}}} #metrics {"StartTime": 1616444985.0060966, "EndTime": 1616444985.0061054, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14080574729071724, "count": 1, "min": 0.14080574729071724, "max": 0.14080574729071724}}} #metrics {"StartTime": 1616444985.0061493, "EndTime": 1616444985.0061586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839994366115993, "count": 1, "min": 0.13839994366115993, "max": 0.13839994366115993}}} #metrics {"StartTime": 1616444985.006188, "EndTime": 1616444985.006194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1408057403225369, "count": 1, "min": 0.1408057403225369, "max": 0.1408057403225369}}} #metrics {"StartTime": 1616444985.0062146, "EndTime": 1616444985.0062199, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17449707044813367, "count": 1, "min": 0.17449707044813367, "max": 0.17449707044813367}}} #metrics {"StartTime": 1616444985.00624, "EndTime": 1616444985.0062456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17335341908772786, "count": 1, "min": 0.17335341908772786, "max": 0.17335341908772786}}} #metrics {"StartTime": 1616444985.0062747, "EndTime": 1616444985.0062828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17379407650417752, "count": 1, "min": 0.17379407650417752, "max": 0.17379407650417752}}} #metrics {"StartTime": 1616444985.0063086, "EndTime": 1616444985.006317, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733537373860677, "count": 1, "min": 0.1733537373860677, "max": 0.1733537373860677}}} #metrics {"StartTime": 1616444985.0063484, "EndTime": 1616444985.006357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321976803249783, "count": 1, "min": 0.17321976803249783, "max": 0.17321976803249783}}} #metrics {"StartTime": 1616444985.0063887, "EndTime": 1616444985.006398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505044335259332, "count": 1, "min": 0.17505044335259332, "max": 0.17505044335259332}}} #metrics {"StartTime": 1616444985.0064273, "EndTime": 1616444985.0064335, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321976138644748, "count": 1, "min": 0.17321976138644748, "max": 0.17321976138644748}}} #metrics {"StartTime": 1616444985.006453, "EndTime": 1616444985.006458, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17505075653076171, "count": 1, "min": 0.17505075653076171, "max": 0.17505075653076171}}} #metrics {"StartTime": 1616444985.0064788, "EndTime": 1616444985.0064864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44767103976779515, "count": 1, "min": 0.44767103976779515, "max": 0.44767103976779515}}} #metrics {"StartTime": 1616444985.006514, "EndTime": 1616444985.0065205, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4477618726942274, "count": 1, "min": 0.4477618726942274, "max": 0.4477618726942274}}} #metrics {"StartTime": 1616444985.0065498, "EndTime": 1616444985.0065584, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.447679539320204, "count": 1, "min": 0.447679539320204, "max": 0.447679539320204}}} #metrics {"StartTime": 1616444985.006592, "EndTime": 1616444985.0066018, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44776187140570745, "count": 1, "min": 0.44776187140570745, "max": 0.44776187140570745}}} #metrics {"StartTime": 1616444985.006631, "EndTime": 1616444985.006639, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768249606662325, "count": 1, "min": 0.44768249606662325, "max": 0.44768249606662325}}} #metrics {"StartTime": 1616444985.0066698, "EndTime": 1616444985.0066786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44859664815266925, "count": 1, "min": 0.44859664815266925, "max": 0.44859664815266925}}} #metrics {"StartTime": 1616444985.0067136, "EndTime": 1616444985.0067232, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768248813205297, "count": 1, "min": 0.44768248813205297, "max": 0.44768248813205297}}} #metrics {"StartTime": 1616444985.0067527, "EndTime": 1616444985.006761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485966485595703, "count": 1, "min": 0.4485966485595703, "max": 0.4485966485595703}}} #metrics {"StartTime": 1616444985.0067906, "EndTime": 1616444985.0067987, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847274918619791, "count": 1, "min": 0.6847274918619791, "max": 0.6847274918619791}}} #metrics {"StartTime": 1616444985.0068295, "EndTime": 1616444985.006836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848278351508247, "count": 1, "min": 0.6848278351508247, "max": 0.6848278351508247}}} #metrics {"StartTime": 1616444985.006856, "EndTime": 1616444985.0068612, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321899414063, "count": 1, "min": 0.6847321899414063, "max": 0.6847321899414063}}} #metrics {"StartTime": 1616444985.0068927, "EndTime": 1616444985.006902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848278667534722, "count": 1, "min": 0.6848278667534722, "max": 0.6848278667534722}}} #metrics {"StartTime": 1616444985.006935, "EndTime": 1616444985.006944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847360727267795, "count": 1, "min": 0.6847360727267795, "max": 0.6847360727267795}}} #metrics {"StartTime": 1616444985.0069768, "EndTime": 1616444985.0069852, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861613454861111, "count": 1, "min": 0.6861613454861111, "max": 0.6861613454861111}}} #metrics {"StartTime": 1616444985.0070176, "EndTime": 1616444985.0070245, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847359544542101, "count": 1, "min": 0.6847359544542101, "max": 0.6847359544542101}}} #metrics {"StartTime": 1616444985.0070503, "EndTime": 1616444985.0070586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861613538953993, "count": 1, "min": 0.6861613538953993, "max": 0.6861613538953993}}} [03/22/2021 20:29:45 INFO 139804890085184] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.154236552734375 [2021-03-22 20:29:46.018] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 41, "duration": 997, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444986.6758795, "EndTime": 1616444986.6759436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553028449788888, "count": 1, "min": 0.1553028449788888, "max": 0.1553028449788888}}} #metrics {"StartTime": 1616444986.6760125, "EndTime": 1616444986.6760232, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14113691572561868, "count": 1, "min": 0.14113691572561868, "max": 0.14113691572561868}}} #metrics {"StartTime": 1616444986.676056, "EndTime": 1616444986.676064, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15527889758575802, "count": 1, "min": 0.15527889758575802, "max": 0.15527889758575802}}} #metrics {"StartTime": 1616444986.6760943, "EndTime": 1616444986.6761024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14124816636022405, "count": 1, "min": 0.14124816636022405, "max": 0.14124816636022405}}} #metrics {"StartTime": 1616444986.676137, "EndTime": 1616444986.676147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010644919148613, "count": 1, "min": 0.14010644919148613, "max": 0.14010644919148613}}} #metrics {"StartTime": 1616444986.6761777, "EndTime": 1616444986.6761856, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101316246640413, "count": 1, "min": 0.14101316246640413, "max": 0.14101316246640413}}} #metrics {"StartTime": 1616444986.6762183, "EndTime": 1616444986.676227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010536622891132, "count": 1, "min": 0.14010536622891132, "max": 0.14010536622891132}}} #metrics {"StartTime": 1616444986.6762643, "EndTime": 1616444986.6762733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14101314872889226, "count": 1, "min": 0.14101314872889226, "max": 0.14101314872889226}}} #metrics {"StartTime": 1616444986.6763005, "EndTime": 1616444986.6763103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17544787685901153, "count": 1, "min": 0.17544787685901153, "max": 0.17544787685901153}}} #metrics {"StartTime": 1616444986.676343, "EndTime": 1616444986.676355, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420799677647322, "count": 1, "min": 0.17420799677647322, "max": 0.17420799677647322}}} #metrics {"StartTime": 1616444986.6763895, "EndTime": 1616444986.6763985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17471522814588428, "count": 1, "min": 0.17471522814588428, "max": 0.17471522814588428}}} #metrics {"StartTime": 1616444986.6764324, "EndTime": 1616444986.6764424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421186737120098, "count": 1, "min": 0.17421186737120098, "max": 0.17421186737120098}}} #metrics {"StartTime": 1616444986.6764786, "EndTime": 1616444986.676488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742160318674761, "count": 1, "min": 0.1742160318674761, "max": 0.1742160318674761}}} #metrics {"StartTime": 1616444986.6765237, "EndTime": 1616444986.6765337, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1762043672608678, "count": 1, "min": 0.1762043672608678, "max": 0.1762043672608678}}} #metrics {"StartTime": 1616444986.6765633, "EndTime": 1616444986.676572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742159989109821, "count": 1, "min": 0.1742159989109821, "max": 0.1742159989109821}}} #metrics {"StartTime": 1616444986.6766, "EndTime": 1616444986.676609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17620520991849334, "count": 1, "min": 0.17620520991849334, "max": 0.17620520991849334}}} #metrics {"StartTime": 1616444986.6766431, "EndTime": 1616444986.676653, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487641902136553, "count": 1, "min": 0.4487641902136553, "max": 0.4487641902136553}}} #metrics {"StartTime": 1616444986.676685, "EndTime": 1616444986.6766942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45025227810445356, "count": 1, "min": 0.45025227810445356, "max": 0.45025227810445356}}} #metrics {"StartTime": 1616444986.676732, "EndTime": 1616444986.6767414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44907179733149144, "count": 1, "min": 0.44907179733149144, "max": 0.44907179733149144}}} #metrics {"StartTime": 1616444986.6767747, "EndTime": 1616444986.6767833, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4502552451363307, "count": 1, "min": 0.4502552451363307, "max": 0.4502552451363307}}} #metrics {"StartTime": 1616444986.6768177, "EndTime": 1616444986.6768258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934689405223716, "count": 1, "min": 0.44934689405223716, "max": 0.44934689405223716}}} #metrics {"StartTime": 1616444986.676872, "EndTime": 1616444986.676882, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4503599571889864, "count": 1, "min": 0.4503599571889864, "max": 0.4503599571889864}}} #metrics {"StartTime": 1616444986.6769187, "EndTime": 1616444986.676928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44934707487308323, "count": 1, "min": 0.44934707487308323, "max": 0.44934707487308323}}} #metrics {"StartTime": 1616444986.6769674, "EndTime": 1616444986.6769767, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4503599525872583, "count": 1, "min": 0.4503599525872583, "max": 0.4503599525872583}}} #metrics {"StartTime": 1616444986.677015, "EndTime": 1616444986.677026, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847793175773628, "count": 1, "min": 0.6847793175773628, "max": 0.6847793175773628}}} #metrics {"StartTime": 1616444986.6770625, "EndTime": 1616444986.6770713, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856955960855556, "count": 1, "min": 0.6856955960855556, "max": 0.6856955960855556}}} #metrics {"StartTime": 1616444986.6771095, "EndTime": 1616444986.6771193, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684826126897168, "count": 1, "min": 0.684826126897168, "max": 0.684826126897168}}} #metrics {"StartTime": 1616444986.6771567, "EndTime": 1616444986.677167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857896784169466, "count": 1, "min": 0.6857896784169466, "max": 0.6857896784169466}}} #metrics {"StartTime": 1616444986.6772013, "EndTime": 1616444986.6772096, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848079064900261, "count": 1, "min": 0.6848079064900261, "max": 0.6848079064900261}}} #metrics {"StartTime": 1616444986.6772444, "EndTime": 1616444986.6772542, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854200475833846, "count": 1, "min": 0.6854200475833846, "max": 0.6854200475833846}}} #metrics {"StartTime": 1616444986.677286, "EndTime": 1616444986.6772943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174182620479, "count": 1, "min": 0.6848174182620479, "max": 0.6848174182620479}}} #metrics {"StartTime": 1616444986.6773202, "EndTime": 1616444986.6773264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854200622006387, "count": 1, "min": 0.6854200622006387, "max": 0.6854200622006387}}} [03/22/2021 20:29:46 INFO 139804890085184] #quality_metric: host=algo-1, epoch=13, validation binary_classification_cross_entropy_objective <loss>=0.1553028449788888 [03/22/2021 20:29:46 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:29:46 INFO 139804890085184] Epoch 13: Loss improved. Updating best model [03/22/2021 20:29:46 INFO 139804890085184] Saving model for epoch: 13 [03/22/2021 20:29:46 INFO 139804890085184] Saved checkpoint to "/tmp/tmpu2qyztkw/mx-mod-0000.params" [03/22/2021 20:29:46 INFO 139804890085184] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs #metrics {"StartTime": 1616444975.098306, "EndTime": 1616444986.6825798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6325454.0, "count": 1, "min": 6325454, "max": 6325454}, "Total Batches Seen": {"sum": 6326.0, "count": 1, "min": 6326, "max": 6326}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:29:46 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38928.33558624867 records/second 2021-03-22 20:30:04 Uploading - Uploading generated training model[2021-03-22 20:29:56.725] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 31, "duration": 10040, "num_examples": 451, "num_bytes": 64938384} #metrics {"StartTime": 1616444996.725469, "EndTime": 1616444996.725535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15417795613606772, "count": 1, "min": 0.15417795613606772, "max": 0.15417795613606772}}} #metrics {"StartTime": 1616444996.7256114, "EndTime": 1616444996.7256255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13945421225653754, "count": 1, "min": 0.13945421225653754, "max": 0.13945421225653754}}} #metrics {"StartTime": 1616444996.7256696, "EndTime": 1616444996.7256799, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15394715025160047, "count": 1, "min": 0.15394715025160047, "max": 0.15394715025160047}}} #metrics {"StartTime": 1616444996.725719, "EndTime": 1616444996.725728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13956278311835396, "count": 1, "min": 0.13956278311835396, "max": 0.13956278311835396}}} #metrics {"StartTime": 1616444996.725769, "EndTime": 1616444996.7257798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839451687282986, "count": 1, "min": 0.13839451687282986, "max": 0.13839451687282986}}} #metrics {"StartTime": 1616444996.725816, "EndTime": 1616444996.7258263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14070810468885633, "count": 1, "min": 0.14070810468885633, "max": 0.14070810468885633}}} #metrics {"StartTime": 1616444996.7258785, "EndTime": 1616444996.7258887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13839344782511392, "count": 1, "min": 0.13839344782511392, "max": 0.13839344782511392}}} #metrics {"StartTime": 1616444996.7259278, "EndTime": 1616444996.725938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14070810000949435, "count": 1, "min": 0.14070810000949435, "max": 0.14070810000949435}}} #metrics {"StartTime": 1616444996.7259777, "EndTime": 1616444996.7259877, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17446750512017145, "count": 1, "min": 0.17446750512017145, "max": 0.17446750512017145}}} #metrics {"StartTime": 1616444996.7260242, "EndTime": 1616444996.726034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1733478029039171, "count": 1, "min": 0.1733478029039171, "max": 0.1733478029039171}}} #metrics {"StartTime": 1616444996.7260723, "EndTime": 1616444996.7260828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17367593594021266, "count": 1, "min": 0.17367593594021266, "max": 0.17367593594021266}}} #metrics {"StartTime": 1616444996.7261176, "EndTime": 1616444996.726127, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17334801384819878, "count": 1, "min": 0.17334801384819878, "max": 0.17334801384819878}}} #metrics {"StartTime": 1616444996.726166, "EndTime": 1616444996.7261765, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.173212844136556, "count": 1, "min": 0.173212844136556, "max": 0.173212844136556}}} #metrics {"StartTime": 1616444996.7262135, "EndTime": 1616444996.7262218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496245463053386, "count": 1, "min": 0.17496245463053386, "max": 0.17496245463053386}}} #metrics {"StartTime": 1616444996.7262583, "EndTime": 1616444996.7262673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321285329182942, "count": 1, "min": 0.17321285329182942, "max": 0.17321285329182942}}} #metrics {"StartTime": 1616444996.726304, "EndTime": 1616444996.7263124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17496264088948568, "count": 1, "min": 0.17496264088948568, "max": 0.17496264088948568}}} #metrics {"StartTime": 1616444996.7263477, "EndTime": 1616444996.7263567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476731841362847, "count": 1, "min": 0.4476731841362847, "max": 0.4476731841362847}}} #metrics {"StartTime": 1616444996.7263937, "EndTime": 1616444996.7264044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775702914767795, "count": 1, "min": 0.44775702914767795, "max": 0.44775702914767795}}} #metrics {"StartTime": 1616444996.7264445, "EndTime": 1616444996.726454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4476795536973741, "count": 1, "min": 0.4476795536973741, "max": 0.4476795536973741}}} #metrics {"StartTime": 1616444996.7264948, "EndTime": 1616444996.7265048, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44775703152126733, "count": 1, "min": 0.44775703152126733, "max": 0.44775703152126733}}} #metrics {"StartTime": 1616444996.7265468, "EndTime": 1616444996.726558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768162156846786, "count": 1, "min": 0.44768162156846786, "max": 0.44768162156846786}}} #metrics {"StartTime": 1616444996.726594, "EndTime": 1616444996.726604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4485684933810764, "count": 1, "min": 0.4485684933810764, "max": 0.4485684933810764}}} #metrics {"StartTime": 1616444996.7266417, "EndTime": 1616444996.7266521, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44768161899142794, "count": 1, "min": 0.44768161899142794, "max": 0.44768161899142794}}} #metrics {"StartTime": 1616444996.7266893, "EndTime": 1616444996.7266984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44856849182128905, "count": 1, "min": 0.44856849182128905, "max": 0.44856849182128905}}} #metrics {"StartTime": 1616444996.7267354, "EndTime": 1616444996.7267442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847277454969618, "count": 1, "min": 0.6847277454969618, "max": 0.6847277454969618}}} #metrics {"StartTime": 1616444996.7267783, "EndTime": 1616444996.7267866, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848239309353299, "count": 1, "min": 0.6848239309353299, "max": 0.6848239309353299}}} #metrics {"StartTime": 1616444996.7268212, "EndTime": 1616444996.7268305, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847321804470486, "count": 1, "min": 0.6847321804470486, "max": 0.6847321804470486}}} #metrics {"StartTime": 1616444996.726868, "EndTime": 1616444996.7268775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848236694335937, "count": 1, "min": 0.6848236694335937, "max": 0.6848236694335937}}} #metrics {"StartTime": 1616444996.7269166, "EndTime": 1616444996.7269268, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847329005262587, "count": 1, "min": 0.6847329005262587, "max": 0.6847329005262587}}} #metrics {"StartTime": 1616444996.7269619, "EndTime": 1616444996.7269714, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036919487847, "count": 1, "min": 0.6861036919487847, "max": 0.6861036919487847}}} #metrics {"StartTime": 1616444996.7270048, "EndTime": 1616444996.727014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847330342610677, "count": 1, "min": 0.6847330342610677, "max": 0.6847330342610677}}} #metrics {"StartTime": 1616444996.7270482, "EndTime": 1616444996.7270572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861036935763889, "count": 1, "min": 0.6861036935763889, "max": 0.6861036935763889}}} [03/22/2021 20:29:56 INFO 139804890085184] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.15417795613606772 [2021-03-22 20:29:57.656] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 44, "duration": 914, "num_examples": 57, "num_bytes": 8117280} #metrics {"StartTime": 1616444998.3241765, "EndTime": 1616444998.3242376, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15524713300698528, "count": 1, "min": 0.15524713300698528, "max": 0.15524713300698528}}} #metrics {"StartTime": 1616444998.3243082, "EndTime": 1616444998.3243213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14095786234916727, "count": 1, "min": 0.14095786234916727, "max": 0.14095786234916727}}} #metrics {"StartTime": 1616444998.3243577, "EndTime": 1616444998.3243678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1547708372962333, "count": 1, "min": 0.1547708372962333, "max": 0.1547708372962333}}} #metrics {"StartTime": 1616444998.3243997, "EndTime": 1616444998.3244085, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14105002921122872, "count": 1, "min": 0.14105002921122872, "max": 0.14105002921122872}}} #metrics {"StartTime": 1616444998.324438, "EndTime": 1616444998.3244474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010144257896523, "count": 1, "min": 0.14010144257896523, "max": 0.14010144257896523}}} #metrics {"StartTime": 1616444998.3244793, "EndTime": 1616444998.3244889, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1410452321126822, "count": 1, "min": 0.1410452321126822, "max": 0.1410452321126822}}} #metrics {"StartTime": 1616444998.3245203, "EndTime": 1616444998.3245304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010051045833125, "count": 1, "min": 0.14010051045833125, "max": 0.14010051045833125}}} #metrics {"StartTime": 1616444998.324563, "EndTime": 1616444998.3245726, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14104529829636012, "count": 1, "min": 0.14104529829636012, "max": 0.14104529829636012}}} #metrics {"StartTime": 1616444998.3246045, "EndTime": 1616444998.3246143, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17541886661753536, "count": 1, "min": 0.17541886661753536, "max": 0.17541886661753536}}} #metrics {"StartTime": 1616444998.324647, "EndTime": 1616444998.3246553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421152298598927, "count": 1, "min": 0.17421152298598927, "max": 0.17421152298598927}}} #metrics {"StartTime": 1616444998.324685, "EndTime": 1616444998.3246942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1746087277128021, "count": 1, "min": 0.1746087277128021, "max": 0.1746087277128021}}} #metrics {"StartTime": 1616444998.3247292, "EndTime": 1616444998.3247397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421424869783006, "count": 1, "min": 0.17421424869783006, "max": 0.17421424869783006}}} #metrics {"StartTime": 1616444998.3247786, "EndTime": 1616444998.3247902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742021917641237, "count": 1, "min": 0.1742021917641237, "max": 0.1742021917641237}}} #metrics {"StartTime": 1616444998.3248296, "EndTime": 1616444998.3248396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17576301714112325, "count": 1, "min": 0.17576301714112325, "max": 0.17576301714112325}}} #metrics {"StartTime": 1616444998.3248894, "EndTime": 1616444998.3249002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17420216713134376, "count": 1, "min": 0.17420216713134376, "max": 0.17420216713134376}}} #metrics {"StartTime": 1616444998.3249352, "EndTime": 1616444998.3249445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17576329405688004, "count": 1, "min": 0.17576329405688004, "max": 0.17576329405688004}}} #metrics {"StartTime": 1616444998.3249786, "EndTime": 1616444998.324988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4487645009656483, "count": 1, "min": 0.4487645009656483, "max": 0.4487645009656483}}} #metrics {"StartTime": 1616444998.3250175, "EndTime": 1616444998.3250246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45038040564460746, "count": 1, "min": 0.45038040564460746, "max": 0.45038040564460746}}} #metrics {"StartTime": 1616444998.3250575, "EndTime": 1616444998.3250668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44907411768522293, "count": 1, "min": 0.44907411768522293, "max": 0.44907411768522293}}} #metrics {"StartTime": 1616444998.3251016, "EndTime": 1616444998.3251112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4503821507823241, "count": 1, "min": 0.4503821507823241, "max": 0.4503821507823241}}} #metrics {"StartTime": 1616444998.3251438, "EndTime": 1616444998.325153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4491206844668873, "count": 1, "min": 0.4491206844668873, "max": 0.4491206844668873}}} #metrics {"StartTime": 1616444998.325191, "EndTime": 1616444998.3252003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44970888980678025, "count": 1, "min": 0.44970888980678025, "max": 0.44970888980678025}}} #metrics {"StartTime": 1616444998.3252332, "EndTime": 1616444998.325242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44912076946351254, "count": 1, "min": 0.44912076946351254, "max": 0.44912076946351254}}} #metrics {"StartTime": 1616444998.3252814, "EndTime": 1616444998.325293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4497088870998814, "count": 1, "min": 0.4497088870998814, "max": 0.4497088870998814}}} #metrics {"StartTime": 1616444998.3253243, "EndTime": 1616444998.325334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6847818179398706, "count": 1, "min": 0.6847818179398706, "max": 0.6847818179398706}}} #metrics {"StartTime": 1616444998.3253646, "EndTime": 1616444998.3253744, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6856624877344998, "count": 1, "min": 0.6856624877344998, "max": 0.6856624877344998}}} #metrics {"StartTime": 1616444998.325407, "EndTime": 1616444998.3254173, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848271479394306, "count": 1, "min": 0.6848271479394306, "max": 0.6848271479394306}}} #metrics {"StartTime": 1616444998.3254538, "EndTime": 1616444998.3254638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857717541445437, "count": 1, "min": 0.6857717541445437, "max": 0.6857717541445437}}} #metrics {"StartTime": 1616444998.325488, "EndTime": 1616444998.3254967, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848174615724302, "count": 1, "min": 0.6848174615724302, "max": 0.6848174615724302}}} #metrics {"StartTime": 1616444998.3255265, "EndTime": 1616444998.325536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247479963751, "count": 1, "min": 0.6855247479963751, "max": 0.6855247479963751}}} #metrics {"StartTime": 1616444998.3255637, "EndTime": 1616444998.3255732, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6848125972751187, "count": 1, "min": 0.6848125972751187, "max": 0.6848125972751187}}} #metrics {"StartTime": 1616444998.3256066, "EndTime": 1616444998.3256164, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6855247428532671, "count": 1, "min": 0.6855247428532671, "max": 0.6855247428532671}}} [03/22/2021 20:29:58 INFO 139804890085184] #quality_metric: host=algo-1, epoch=14, validation binary_classification_cross_entropy_objective <loss>=0.15524713300698528 [03/22/2021 20:29:58 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:29:58 INFO 139804890085184] Epoch 14: Loss improved. Updating best model [03/22/2021 20:29:58 INFO 139804890085184] Saving model for epoch: 14 [03/22/2021 20:29:58 INFO 139804890085184] Saved checkpoint to "/tmp/tmpboe6wiue/mx-mod-0000.params" [03/22/2021 20:29:58 INFO 139804890085184] #progress_metric: host=algo-1, completed 100.0 % of epochs #metrics {"StartTime": 1616444986.685221, "EndTime": 1616444998.330813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6776415.0, "count": 1, "min": 6776415, "max": 6776415}, "Total Batches Seen": {"sum": 6777.0, "count": 1, "min": 6777, "max": 6777}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:29:58 INFO 139804890085184] #throughput_metric: host=algo-1, train throughput=38723.38836886263 records/second [03/22/2021 20:29:58 WARNING 139804890085184] wait_for_all_workers will not sync workers since the kv store is not running distributed [03/22/2021 20:29:58 WARNING 139804890085184] wait_for_all_workers will not sync workers since the kv store is not running distributed [2021-03-22 20:29:59.409] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 47, "duration": 1065, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:30:00 INFO 139804890085184] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:30:00 INFO 139804890085184] Epoch 14: Loss improved. Updating best model [2021-03-22 20:30:00.220] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 49, "duration": 137, "num_examples": 57, "num_bytes": 8117280} [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.14010144257896523) [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('binary_classification_accuracy', 0.9505765478091184) [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('binary_f_1.000', 0.9500591546266088) [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('precision', 0.9693112403526098) [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('recall', 0.9315569304320315) [03/22/2021 20:30:00 INFO 139804890085184] #validation_score (algo-1) : ('roc_auc_score', 0.9841679724274172) [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation binary_classification_cross_entropy_objective <loss>=0.14010144257896523 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation binary_classification_accuracy <score>=0.9505765478091184 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation binary_f_1.000 <score>=0.9500591546266088 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation precision <score>=0.9693112403526098 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation recall <score>=0.9315569304320315 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, validation roc_auc_score <score>=0.9841679724274172 [03/22/2021 20:30:00 INFO 139804890085184] Best model found for hyperparameters: {"optimizer": "adam", "learning_rate": 0.1, "wd": 0.0001, "l1": 0.0, "lr_scheduler_step": 10, "lr_scheduler_factor": 0.99, "lr_scheduler_minimum_lr": 1e-05} [03/22/2021 20:30:00 INFO 139804890085184] Saved checkpoint to "/tmp/tmphun2xft4/mx-mod-0000.params" [2021-03-22 20:30:00.244] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 0, "duration": 183246, "num_examples": 1, "num_bytes": 144000} [2021-03-22 20:30:00.386] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 1, "duration": 141, "num_examples": 57, "num_bytes": 8117424} #metrics {"StartTime": 1616445000.2442653, "EndTime": 1616445000.40551, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "test_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Total Batches Seen": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Max Records Seen Between Resets": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Max Batches Seen Between Resets": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Reset Count": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Number of Records Since Last Reset": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Number of Batches Since Last Reset": {"sum": 57.0, "count": 1, "min": 57, "max": 57}}} [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.14020745600416684) [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('binary_classification_accuracy', 0.9501694133508364) [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('binary_f_1.000', 0.9494465940790066) [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('precision', 0.9702074444607915) [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('recall', 0.9295556260351693) [03/22/2021 20:30:00 INFO 139804890085184] #test_score (algo-1) : ('roc_auc_score', 0.9838786909338999) [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test binary_classification_cross_entropy_objective <loss>=0.14020745600416684 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test binary_classification_accuracy <score>=0.9501694133508364 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test binary_f_1.000 <score>=0.9494465940790066 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test precision <score>=0.9702074444607915 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test recall <score>=0.9295556260351693 [03/22/2021 20:30:00 INFO 139804890085184] #quality_metric: host=algo-1, test roc_auc_score <score>=0.9838786909338999 #metrics {"StartTime": 1616444816.991062, "EndTime": 1616445000.4094992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training"}, "Metrics": {"initialize.time": {"sum": 200.25014877319336, "count": 1, "min": 200.25014877319336, "max": 200.25014877319336}, "epochs": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "check_early_stopping.time": {"sum": 12.824773788452148, "count": 16, "min": 0.7088184356689453, "max": 0.9787082672119141}, "update.time": {"sum": 181050.41027069092, "count": 15, "min": 11582.106590270996, "max": 13113.190650939941}, "finalize.time": {"sum": 1910.9811782836914, "count": 1, "min": 1910.9811782836914, "max": 1910.9811782836914}, "setuptime": {"sum": 20.27440071105957, "count": 1, "min": 20.27440071105957, "max": 20.27440071105957}, "totaltime": {"sum": 183595.46971321106, "count": 1, "min": 183595.46971321106, "max": 183595.46971321106}}} 2021-03-22 20:30:32 Completed - Training job completed ProfilerReport-1616444642: NoIssuesFound Training seconds: 235 Billable seconds: 235
smote_df = smote_df.sample(frac=1)
smote_df.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V8 | V9 | V10 | V11 | ... | V22 | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Hour | Target | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 444638 | -1.591619 | 3.821128 | -7.453098 | 7.169654 | -1.585670 | -1.764038 | 1.598013 | -2.293247 | -6.855235 | 6.893441 | ... | 0.259756 | -0.073674 | -0.522221 | -0.611021 | 0.005976 | 0.300756 | -0.308927 | 2.112794 | 4 | 1 |
| 249622 | 1.891076 | -0.570211 | -0.507267 | 0.283717 | -0.578061 | -0.171396 | 0.139476 | 1.218316 | 0.020303 | 0.271478 | ... | -0.454308 | 0.277269 | -0.566051 | -0.448963 | -0.612983 | 0.015300 | -0.040608 | 49.990000 | 19 | 0 |
| 481887 | 1.411728 | 0.957441 | -0.936265 | 3.555220 | 0.503031 | -0.372009 | 0.179135 | -0.537993 | -0.250580 | 0.804410 | ... | -0.166179 | -0.010351 | -0.235448 | 0.229353 | 0.107602 | 0.028963 | 0.051982 | 0.429556 | 17 | 1 |
| 399938 | -2.063357 | -0.646713 | -2.206225 | 2.059792 | -3.988727 | 0.462521 | 0.635093 | -0.768823 | -4.543119 | 2.976180 | ... | 0.638918 | 1.699302 | 0.312863 | 0.487601 | -0.198049 | 0.167841 | 0.181623 | 817.177640 | 17 | 1 |
| 114427 | -0.595087 | 1.334715 | 1.183348 | -0.055506 | 0.241736 | -0.509307 | 0.029552 | -0.334808 | -0.271364 | 0.174117 | ... | -0.528052 | 0.010147 | 0.041667 | -0.155195 | 0.103328 | 0.373395 | 0.156365 | 0.890000 | 20 | 0 |
5 rows × 26 columns
count = smote_df.groupby('Hour')['Target'].sum()
smote_df['count_target'] = smote_df['Hour'].map(count)
smote_df.head()
| V1 | V2 | V3 | V4 | V5 | V6 | V8 | V9 | V10 | V11 | ... | V23 | V24 | V25 | V26 | V27 | V28 | Amount | Hour | Target | count_target | |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 444638 | -1.591619 | 3.821128 | -7.453098 | 7.169654 | -1.585670 | -1.764038 | 1.598013 | -2.293247 | -6.855235 | 6.893441 | ... | -0.073674 | -0.522221 | -0.611021 | 0.005976 | 0.300756 | -0.308927 | 2.112794 | 4 | 1 | 10114 |
| 249622 | 1.891076 | -0.570211 | -0.507267 | 0.283717 | -0.578061 | -0.171396 | 0.139476 | 1.218316 | 0.020303 | 0.271478 | ... | 0.277269 | -0.566051 | -0.448963 | -0.612983 | 0.015300 | -0.040608 | 49.990000 | 19 | 0 | 12716 |
| 481887 | 1.411728 | 0.957441 | -0.936265 | 3.555220 | 0.503031 | -0.372009 | 0.179135 | -0.537993 | -0.250580 | 0.804410 | ... | -0.010351 | -0.235448 | 0.229353 | 0.107602 | 0.028963 | 0.051982 | 0.429556 | 17 | 1 | 17219 |
| 399938 | -2.063357 | -0.646713 | -2.206225 | 2.059792 | -3.988727 | 0.462521 | 0.635093 | -0.768823 | -4.543119 | 2.976180 | ... | 1.699302 | 0.312863 | 0.487601 | -0.198049 | 0.167841 | 0.181623 | 817.177640 | 17 | 1 | 17219 |
| 114427 | -0.595087 | 1.334715 | 1.183348 | -0.055506 | 0.241736 | -0.509307 | 0.029552 | -0.334808 | -0.271364 | 0.174117 | ... | 0.010147 | 0.041667 | -0.155195 | 0.103328 | 0.373395 | 0.156365 | 0.890000 | 20 | 0 | 8512 |
5 rows × 27 columns
train_features, test_features, train_labels, test_labels, val_features, val_labels = create_training_sets(smote_df,'Target')
scaler = StandardScaler()
scaler.fit(train_features)
train_features_scaled = scaler.transform(train_features)
val_features_scaled = scaler.transform(val_features)
test_features_scaled = scaler.transform(test_features)
linear_estimator_smote_co_target = sagemaker.LinearLearner(role=sagemaker.get_execution_role(),
train_instance_count=1,
train_instance_type='ml.m5.xlarge',
predictor_type='binary_classifier')
train_records_smote = linear_estimator_smote_co_target.record_set(train_features_scaled, train_labels, channel='train')
val_records_smote = linear_estimator_smote_co_target.record_set(val_features_scaled, val_labels, channel='validation')
test_records_smote = linear_estimator_smote_co_target.record_set(test_features_scaled, test_labels, channel='test')
linear_estimator_smote_co_target.fit([train_records_smote, val_records_smote, test_records_smote])
train_instance_count has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. train_instance_type has been renamed in sagemaker>=2. See: https://sagemaker.readthedocs.io/en/stable/v2.html for details. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
2021-03-22 20:39:42 Starting - Starting the training job... 2021-03-22 20:39:44 Starting - Launching requested ML instancesProfilerReport-1616445582: InProgress ...... 2021-03-22 20:41:09 Starting - Preparing the instances for training...... 2021-03-22 20:42:09 Downloading - Downloading input data 2021-03-22 20:42:09 Training - Downloading the training image..Docker entrypoint called with argument(s): train Running default environment configuration script [03/22/2021 20:42:22 INFO 139901614024512] Reading default configuration from /opt/amazon/lib/python3.7/site-packages/algorithm/resources/default-input.json: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': 'auto', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false'} [03/22/2021 20:42:22 INFO 139901614024512] Merging with provided configuration from /opt/ml/input/config/hyperparameters.json: {'feature_dim': '26', 'predictor_type': 'binary_classifier', 'mini_batch_size': '1000'} [03/22/2021 20:42:22 INFO 139901614024512] Final configuration: {'mini_batch_size': '1000', 'epochs': '15', 'feature_dim': '26', 'use_bias': 'true', 'binary_classifier_model_selection_criteria': 'accuracy', 'f_beta': '1.0', 'target_recall': '0.8', 'target_precision': '0.8', 'num_models': 'auto', 'num_calibration_samples': '10000000', 'init_method': 'uniform', 'init_scale': '0.07', 'init_sigma': '0.01', 'init_bias': '0.0', 'optimizer': 'auto', 'loss': 'auto', 'margin': '1.0', 'quantile': '0.5', 'loss_insensitivity': '0.01', 'huber_delta': '1.0', 'num_classes': '1', 'accuracy_top_k': '3', 'wd': 'auto', 'l1': 'auto', 'momentum': 'auto', 'learning_rate': 'auto', 'beta_1': 'auto', 'beta_2': 'auto', 'bias_lr_mult': 'auto', 'bias_wd_mult': 'auto', 'use_lr_scheduler': 'true', 'lr_scheduler_step': 'auto', 'lr_scheduler_factor': 'auto', 'lr_scheduler_minimum_lr': 'auto', 'positive_example_weight_mult': '1.0', 'balance_multiclass_weights': 'false', 'normalize_data': 'true', 'normalize_label': 'auto', 'unbias_data': 'auto', 'unbias_label': 'auto', 'num_point_for_scaler': '10000', '_kvstore': 'auto', '_num_gpus': 'auto', '_num_kv_servers': 'auto', '_log_level': 'info', '_tuning_objective_metric': '', 'early_stopping_patience': '3', 'early_stopping_tolerance': '0.001', '_enable_profiler': 'false', 'predictor_type': 'binary_classifier'} [03/22/2021 20:42:22 WARNING 139901614024512] Loggers have already been setup. Process 1 is a worker. [03/22/2021 20:42:22 INFO 139901614024512] Using default worker. [03/22/2021 20:42:22 INFO 139901614024512] Checkpoint loading and saving are disabled. [2021-03-22 20:42:22.952] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:42:22.956] [tensorio] [warning] TensorIO is already initialized; ignoring the initialization routine. [2021-03-22 20:42:22.990] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 0, "duration": 40, "num_examples": 1, "num_bytes": 148000} [03/22/2021 20:42:22 INFO 139901614024512] Create Store: local [2021-03-22 20:42:23.064] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 1, "duration": 72, "num_examples": 11, "num_bytes": 1628000} [03/22/2021 20:42:23 INFO 139901614024512] Scaler algorithm parameters <algorithm.scaler.ScalerAlgorithmStable object at 0x7f3d015bb710> [03/22/2021 20:42:23 INFO 139901614024512] Scaling model computed with parameters: {'stdev_label': None, 'stdev_weight': [0.96802884 0.96911675 0.97976017 0.9930348 0.97121465 0.9738839 0.94081396 0.9817014 0.98047036 1.0071722 1.0040985 0.98745567 0.99431556 0.99716836 0.9357948 0.9279335 0.9603426 0.87602645 0.996554 0.9713643 1.0018852 0.949358 0.92951745 0.9130086 1.0028105 0.99903184] <NDArray 26 @cpu(0)>, 'mean_label': None, 'mean_weight': [ 0.01596332 -0.01373685 0.01608671 -0.00893425 0.01448235 -0.00618823 0.00494079 0.0102222 0.01047051 -0.00396932 0.01217606 -0.00725947 0.00877726 -0.00841601 -0.01883686 0.00846823 0.00236239 0.00708804 0.00210458 0.01874818 0.01249217 0.01035901 -0.01252147 -0.00593502 -0.00187065 -0.01973311] <NDArray 26 @cpu(0)>} [03/22/2021 20:42:23 INFO 139901614024512] nvidia-smi took: 0.02519822120666504 secs to identify 0 gpus [03/22/2021 20:42:23 INFO 139901614024512] Number of GPUs being used: 0 #metrics {"StartTime": 1616445743.1574588, "EndTime": 1616445743.1574917, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "init_train_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 12000.0, "count": 1, "min": 12000, "max": 12000}, "Total Batches Seen": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Max Records Seen Between Resets": {"sum": 11000.0, "count": 1, "min": 11000, "max": 11000}, "Max Batches Seen Between Resets": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Reset Count": {"sum": 2.0, "count": 1, "min": 2, "max": 2}, "Number of Records Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}, "Number of Batches Since Last Reset": {"sum": 0.0, "count": 1, "min": 0, "max": 0}}} 2021-03-22 20:42:29 Training - Training image download completed. Training in progress.[2021-03-22 20:42:32.898] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 3, "duration": 9740, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445752.8987722, "EndTime": 1616445752.8988616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2676020180596246, "count": 1, "min": 0.2676020180596246, "max": 0.2676020180596246}}} #metrics {"StartTime": 1616445752.898945, "EndTime": 1616445752.89896, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.27286812391493054, "count": 1, "min": 0.27286812391493054, "max": 0.27286812391493054}}} #metrics {"StartTime": 1616445752.8990061, "EndTime": 1616445752.8990178, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2644510130479601, "count": 1, "min": 0.2644510130479601, "max": 0.2644510130479601}}} #metrics {"StartTime": 1616445752.8990648, "EndTime": 1616445752.899077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2657886355251736, "count": 1, "min": 0.2657886355251736, "max": 0.2657886355251736}}} #metrics {"StartTime": 1616445752.899121, "EndTime": 1616445752.8991332, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15378768444485136, "count": 1, "min": 0.15378768444485136, "max": 0.15378768444485136}}} #metrics {"StartTime": 1616445752.8991864, "EndTime": 1616445752.8991964, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1529059452311198, "count": 1, "min": 0.1529059452311198, "max": 0.1529059452311198}}} #metrics {"StartTime": 1616445752.8992367, "EndTime": 1616445752.899246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15481755901760524, "count": 1, "min": 0.15481755901760524, "max": 0.15481755901760524}}} #metrics {"StartTime": 1616445752.899286, "EndTime": 1616445752.899296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15477704627143013, "count": 1, "min": 0.15477704627143013, "max": 0.15477704627143013}}} #metrics {"StartTime": 1616445752.8993351, "EndTime": 1616445752.8993442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2663032180107964, "count": 1, "min": 0.2663032180107964, "max": 0.2663032180107964}}} #metrics {"StartTime": 1616445752.8993776, "EndTime": 1616445752.8993864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2703076743910048, "count": 1, "min": 0.2703076743910048, "max": 0.2703076743910048}}} #metrics {"StartTime": 1616445752.8994203, "EndTime": 1616445752.8994296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.26960923634847006, "count": 1, "min": 0.26960923634847006, "max": 0.26960923634847006}}} #metrics {"StartTime": 1616445752.8994634, "EndTime": 1616445752.8994715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.2653239634874132, "count": 1, "min": 0.2653239634874132, "max": 0.2653239634874132}}} #metrics {"StartTime": 1616445752.8995028, "EndTime": 1616445752.899512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17891855021158853, "count": 1, "min": 0.17891855021158853, "max": 0.17891855021158853}}} #metrics {"StartTime": 1616445752.8995454, "EndTime": 1616445752.8995538, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17960910396999782, "count": 1, "min": 0.17960910396999782, "max": 0.17960910396999782}}} #metrics {"StartTime": 1616445752.8995862, "EndTime": 1616445752.899594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17919558515760634, "count": 1, "min": 0.17919558515760634, "max": 0.17919558515760634}}} #metrics {"StartTime": 1616445752.899625, "EndTime": 1616445752.899634, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1796119566514757, "count": 1, "min": 0.1796119566514757, "max": 0.1796119566514757}}} #metrics {"StartTime": 1616445752.8996675, "EndTime": 1616445752.8996763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44864069240993926, "count": 1, "min": 0.44864069240993926, "max": 0.44864069240993926}}} #metrics {"StartTime": 1616445752.8997104, "EndTime": 1616445752.89972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44951233757866754, "count": 1, "min": 0.44951233757866754, "max": 0.44951233757866754}}} #metrics {"StartTime": 1616445752.8997536, "EndTime": 1616445752.899762, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4505336920844184, "count": 1, "min": 0.4505336920844184, "max": 0.4505336920844184}}} #metrics {"StartTime": 1616445752.8997936, "EndTime": 1616445752.899803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44856260884602867, "count": 1, "min": 0.44856260884602867, "max": 0.44856260884602867}}} #metrics {"StartTime": 1616445752.8998373, "EndTime": 1616445752.8998463, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4462541470675998, "count": 1, "min": 0.4462541470675998, "max": 0.4462541470675998}}} #metrics {"StartTime": 1616445752.8998847, "EndTime": 1616445752.899894, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4463893204752604, "count": 1, "min": 0.4463893204752604, "max": 0.4463893204752604}}} #metrics {"StartTime": 1616445752.899928, "EndTime": 1616445752.8999379, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4460189453125, "count": 1, "min": 0.4460189453125, "max": 0.4460189453125}}} #metrics {"StartTime": 1616445752.8999743, "EndTime": 1616445752.8999844, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4462539047580295, "count": 1, "min": 0.4462539047580295, "max": 0.4462539047580295}}} #metrics {"StartTime": 1616445752.9000268, "EndTime": 1616445752.9000382, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6846374016655816, "count": 1, "min": 0.6846374016655816, "max": 0.6846374016655816}}} #metrics {"StartTime": 1616445752.900079, "EndTime": 1616445752.9000888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6849148486328125, "count": 1, "min": 0.6849148486328125, "max": 0.6849148486328125}}} #metrics {"StartTime": 1616445752.900124, "EndTime": 1616445752.9001336, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847621293131511, "count": 1, "min": 0.6847621293131511, "max": 0.6847621293131511}}} #metrics {"StartTime": 1616445752.9001667, "EndTime": 1616445752.9001758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6853113359917534, "count": 1, "min": 0.6853113359917534, "max": 0.6853113359917534}}} #metrics {"StartTime": 1616445752.9002073, "EndTime": 1616445752.900216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6867912605794271, "count": 1, "min": 0.6867912605794271, "max": 0.6867912605794271}}} #metrics {"StartTime": 1616445752.9002502, "EndTime": 1616445752.9002595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6871125950792101, "count": 1, "min": 0.6871125950792101, "max": 0.6871125950792101}}} #metrics {"StartTime": 1616445752.9002976, "EndTime": 1616445752.9003077, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6866499944390191, "count": 1, "min": 0.6866499944390191, "max": 0.6866499944390191}}} #metrics {"StartTime": 1616445752.900346, "EndTime": 1616445752.9003558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6870612756347656, "count": 1, "min": 0.6870612756347656, "max": 0.6870612756347656}}} [03/22/2021 20:42:32 INFO 139901614024512] #quality_metric: host=algo-1, epoch=0, train binary_classification_cross_entropy_objective <loss>=0.2676020180596246 [2021-03-22 20:42:32.916] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 0, "duration": 9963, "num_examples": 1, "num_bytes": 148000} [2021-03-22 20:42:34.137] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 2, "duration": 1221, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445755.0513687, "EndTime": 1616445755.0514352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19949987092423316, "count": 1, "min": 0.19949987092423316, "max": 0.19949987092423316}}} #metrics {"StartTime": 1616445755.0515091, "EndTime": 1616445755.0515192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19653058176411156, "count": 1, "min": 0.19653058176411156, "max": 0.19653058176411156}}} #metrics {"StartTime": 1616445755.0515506, "EndTime": 1616445755.0515594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19930811055230613, "count": 1, "min": 0.19930811055230613, "max": 0.19930811055230613}}} #metrics {"StartTime": 1616445755.051592, "EndTime": 1616445755.0516002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19341565020989077, "count": 1, "min": 0.19341565020989077, "max": 0.19341565020989077}}} #metrics {"StartTime": 1616445755.0516315, "EndTime": 1616445755.0516388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14377921535673982, "count": 1, "min": 0.14377921535673982, "max": 0.14377921535673982}}} #metrics {"StartTime": 1616445755.0516667, "EndTime": 1616445755.0516746, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14306865717177486, "count": 1, "min": 0.14306865717177486, "max": 0.14306865717177486}}} #metrics {"StartTime": 1616445755.0517113, "EndTime": 1616445755.0517213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14398907723527482, "count": 1, "min": 0.14398907723527482, "max": 0.14398907723527482}}} #metrics {"StartTime": 1616445755.0517578, "EndTime": 1616445755.051768, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14330556861724503, "count": 1, "min": 0.14330556861724503, "max": 0.14330556861724503}}} #metrics {"StartTime": 1616445755.051809, "EndTime": 1616445755.05182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2044544866242814, "count": 1, "min": 0.2044544866242814, "max": 0.2044544866242814}}} #metrics {"StartTime": 1616445755.0518599, "EndTime": 1616445755.05187, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.201499365914348, "count": 1, "min": 0.201499365914348, "max": 0.201499365914348}}} #metrics {"StartTime": 1616445755.0519073, "EndTime": 1616445755.0519168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.2061773977233984, "count": 1, "min": 0.2061773977233984, "max": 0.2061773977233984}}} #metrics {"StartTime": 1616445755.0519512, "EndTime": 1616445755.0519583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.19900951280605714, "count": 1, "min": 0.19900951280605714, "max": 0.19900951280605714}}} #metrics {"StartTime": 1616445755.0519793, "EndTime": 1616445755.0519853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1742211894572828, "count": 1, "min": 0.1742211894572828, "max": 0.1742211894572828}}} #metrics {"StartTime": 1616445755.0520053, "EndTime": 1616445755.0520132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17498066583930844, "count": 1, "min": 0.17498066583930844, "max": 0.17498066583930844}}} #metrics {"StartTime": 1616445755.052042, "EndTime": 1616445755.0520494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17412903667109558, "count": 1, "min": 0.17412903667109558, "max": 0.17412903667109558}}} #metrics {"StartTime": 1616445755.0520697, "EndTime": 1616445755.0520763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17504243882852433, "count": 1, "min": 0.17504243882852433, "max": 0.17504243882852433}}} #metrics {"StartTime": 1616445755.0521057, "EndTime": 1616445755.052114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4442124346966056, "count": 1, "min": 0.4442124346966056, "max": 0.4442124346966056}}} #metrics {"StartTime": 1616445755.0521455, "EndTime": 1616445755.052154, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4440572720037531, "count": 1, "min": 0.4440572720037531, "max": 0.4440572720037531}}} #metrics {"StartTime": 1616445755.0521874, "EndTime": 1616445755.0521963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4441337440630128, "count": 1, "min": 0.4441337440630128, "max": 0.4441337440630128}}} #metrics {"StartTime": 1616445755.0522296, "EndTime": 1616445755.0522392, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4441758130614758, "count": 1, "min": 0.4441758130614758, "max": 0.4441758130614758}}} #metrics {"StartTime": 1616445755.052274, "EndTime": 1616445755.052283, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4425772360544034, "count": 1, "min": 0.4425772360544034, "max": 0.4425772360544034}}} #metrics {"StartTime": 1616445755.0523229, "EndTime": 1616445755.0523326, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4469078460525532, "count": 1, "min": 0.4469078460525532, "max": 0.4469078460525532}}} #metrics {"StartTime": 1616445755.052372, "EndTime": 1616445755.0523818, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.443334437423254, "count": 1, "min": 0.443334437423254, "max": 0.443334437423254}}} #metrics {"StartTime": 1616445755.0524192, "EndTime": 1616445755.0524285, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44818859144328904, "count": 1, "min": 0.44818859144328904, "max": 0.44818859144328904}}} #metrics {"StartTime": 1616445755.0524626, "EndTime": 1616445755.0524719, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6841277188309038, "count": 1, "min": 0.6841277188309038, "max": 0.6841277188309038}}} #metrics {"StartTime": 1616445755.0525062, "EndTime": 1616445755.0525155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842847798719502, "count": 1, "min": 0.6842847798719502, "max": 0.6842847798719502}}} #metrics {"StartTime": 1616445755.052538, "EndTime": 1616445755.0525434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842097178363242, "count": 1, "min": 0.6842097178363242, "max": 0.6842097178363242}}} #metrics {"StartTime": 1616445755.0525627, "EndTime": 1616445755.052569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842155503913699, "count": 1, "min": 0.6842155503913699, "max": 0.6842155503913699}}} #metrics {"StartTime": 1616445755.052597, "EndTime": 1616445755.0526054, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6820772017742358, "count": 1, "min": 0.6820772017742358, "max": 0.6820772017742358}}} #metrics {"StartTime": 1616445755.052632, "EndTime": 1616445755.0526392, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6860195144347441, "count": 1, "min": 0.6860195144347441, "max": 0.6860195144347441}}} #metrics {"StartTime": 1616445755.0526617, "EndTime": 1616445755.0526695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6824756445689301, "count": 1, "min": 0.6824756445689301, "max": 0.6824756445689301}}} #metrics {"StartTime": 1616445755.052696, "EndTime": 1616445755.052703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.68590501315293, "count": 1, "min": 0.68590501315293, "max": 0.68590501315293}}} [03/22/2021 20:42:35 INFO 139901614024512] #quality_metric: host=algo-1, epoch=0, validation binary_classification_cross_entropy_objective <loss>=0.19949987092423316 [03/22/2021 20:42:35 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=0, criteria=sampled_accuracy, value=0.9489799538761754 [03/22/2021 20:42:35 INFO 139901614024512] Epoch 0: Loss improved. Updating best model [03/22/2021 20:42:35 INFO 139901614024512] Saving model for epoch: 0 [03/22/2021 20:42:35 INFO 139901614024512] Saved checkpoint to "/tmp/tmpxurtxz9u/mx-mod-0000.params" [03/22/2021 20:42:35 INFO 139901614024512] #progress_metric: host=algo-1, completed 6.666666666666667 % of epochs #metrics {"StartTime": 1616445743.157767, "EndTime": 1616445755.0618076, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 0, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 462961.0, "count": 1, "min": 462961, "max": 462961}, "Total Batches Seen": {"sum": 463.0, "count": 1, "min": 463, "max": 463}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 3.0, "count": 1, "min": 3, "max": 3}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:42:35 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=37882.63775645374 records/second [2021-03-22 20:42:45.133] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 5, "duration": 10069, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445765.133964, "EndTime": 1616445765.1340375, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18331558305528428, "count": 1, "min": 0.18331558305528428, "max": 0.18331558305528428}}} #metrics {"StartTime": 1616445765.134115, "EndTime": 1616445765.1341295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17742171223958333, "count": 1, "min": 0.17742171223958333, "max": 0.17742171223958333}}} #metrics {"StartTime": 1616445765.1341715, "EndTime": 1616445765.1341825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18323573028564452, "count": 1, "min": 0.18323573028564452, "max": 0.18323573028564452}}} #metrics {"StartTime": 1616445765.1342213, "EndTime": 1616445765.1342323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1753364875962999, "count": 1, "min": 0.1753364875962999, "max": 0.1753364875962999}}} #metrics {"StartTime": 1616445765.1342735, "EndTime": 1616445765.1342843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13989833470662436, "count": 1, "min": 0.13989833470662436, "max": 0.13989833470662436}}} #metrics {"StartTime": 1616445765.1343205, "EndTime": 1616445765.1343312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091695983886718, "count": 1, "min": 0.14091695983886718, "max": 0.14091695983886718}}} #metrics {"StartTime": 1616445765.134381, "EndTime": 1616445765.1343913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14001384772406683, "count": 1, "min": 0.14001384772406683, "max": 0.14001384772406683}}} #metrics {"StartTime": 1616445765.134427, "EndTime": 1616445765.1344366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14091899191962348, "count": 1, "min": 0.14091899191962348, "max": 0.14091899191962348}}} #metrics {"StartTime": 1616445765.1344767, "EndTime": 1616445765.1344864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.19141664218478732, "count": 1, "min": 0.19141664218478732, "max": 0.19141664218478732}}} #metrics {"StartTime": 1616445765.1345253, "EndTime": 1616445765.1345346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18681563568115234, "count": 1, "min": 0.18681563568115234, "max": 0.18681563568115234}}} #metrics {"StartTime": 1616445765.1345732, "EndTime": 1616445765.134583, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1926005929904514, "count": 1, "min": 0.1926005929904514, "max": 0.1926005929904514}}} #metrics {"StartTime": 1616445765.1346226, "EndTime": 1616445765.1346323, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1852347061835395, "count": 1, "min": 0.1852347061835395, "max": 0.1852347061835395}}} #metrics {"StartTime": 1616445765.1346664, "EndTime": 1616445765.1346748, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321771555582682, "count": 1, "min": 0.17321771555582682, "max": 0.17321771555582682}}} #metrics {"StartTime": 1616445765.134706, "EndTime": 1616445765.1347156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17460162868923612, "count": 1, "min": 0.17460162868923612, "max": 0.17460162868923612}}} #metrics {"StartTime": 1616445765.1347494, "EndTime": 1616445765.1347582, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17321957631429036, "count": 1, "min": 0.17321957631429036, "max": 0.17321957631429036}}} #metrics {"StartTime": 1616445765.1347904, "EndTime": 1616445765.1348147, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1746000148179796, "count": 1, "min": 0.1746000148179796, "max": 0.1746000148179796}}} #metrics {"StartTime": 1616445765.1348524, "EndTime": 1616445765.1348615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439982200792101, "count": 1, "min": 0.4439982200792101, "max": 0.4439982200792101}}} #metrics {"StartTime": 1616445765.1348915, "EndTime": 1616445765.1349003, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44402825358072917, "count": 1, "min": 0.44402825358072917, "max": 0.44402825358072917}}} #metrics {"StartTime": 1616445765.1349351, "EndTime": 1616445765.1349437, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439966003417969, "count": 1, "min": 0.4439966003417969, "max": 0.4439966003417969}}} #metrics {"StartTime": 1616445765.134969, "EndTime": 1616445765.1349776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440354491509332, "count": 1, "min": 0.4440354491509332, "max": 0.4440354491509332}}} #metrics {"StartTime": 1616445765.135014, "EndTime": 1616445765.1350234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44492226169162324, "count": 1, "min": 0.44492226169162324, "max": 0.44492226169162324}}} #metrics {"StartTime": 1616445765.1350577, "EndTime": 1616445765.1350665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4455133568657769, "count": 1, "min": 0.4455133568657769, "max": 0.4455133568657769}}} #metrics {"StartTime": 1616445765.1351035, "EndTime": 1616445765.1351132, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44489662353515624, "count": 1, "min": 0.44489662353515624, "max": 0.44489662353515624}}} #metrics {"StartTime": 1616445765.1351492, "EndTime": 1616445765.1351588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4454918090142144, "count": 1, "min": 0.4454918090142144, "max": 0.4454918090142144}}} #metrics {"StartTime": 1616445765.1351888, "EndTime": 1616445765.1351948, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684529856499566, "count": 1, "min": 0.684529856499566, "max": 0.684529856499566}}} #metrics {"StartTime": 1616445765.1352167, "EndTime": 1616445765.1352243, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845819463433159, "count": 1, "min": 0.6845819463433159, "max": 0.6845819463433159}}} #metrics {"StartTime": 1616445765.1352563, "EndTime": 1616445765.1352658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845319519042968, "count": 1, "min": 0.6845319519042968, "max": 0.6845319519042968}}} #metrics {"StartTime": 1616445765.1353, "EndTime": 1616445765.1353095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845821173773872, "count": 1, "min": 0.6845821173773872, "max": 0.6845821173773872}}} #metrics {"StartTime": 1616445765.1353452, "EndTime": 1616445765.135355, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685632269422743, "count": 1, "min": 0.685632269422743, "max": 0.685632269422743}}} #metrics {"StartTime": 1616445765.1353762, "EndTime": 1616445765.1353817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.686304681125217, "count": 1, "min": 0.686304681125217, "max": 0.686304681125217}}} #metrics {"StartTime": 1616445765.1354008, "EndTime": 1616445765.1354055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856318722873264, "count": 1, "min": 0.6856318722873264, "max": 0.6856318722873264}}} #metrics {"StartTime": 1616445765.1354375, "EndTime": 1616445765.135446, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863040614149306, "count": 1, "min": 0.6863040614149306, "max": 0.6863040614149306}}} [03/22/2021 20:42:45 INFO 139901614024512] #quality_metric: host=algo-1, epoch=1, train binary_classification_cross_entropy_objective <loss>=0.18331558305528428 [2021-03-22 20:42:46.170] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 5, "duration": 1019, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445766.8011024, "EndTime": 1616445766.8011594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1750952926535587, "count": 1, "min": 0.1750952926535587, "max": 0.1750952926535587}}} #metrics {"StartTime": 1616445766.8012285, "EndTime": 1616445766.8012395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16765171536237017, "count": 1, "min": 0.16765171536237017, "max": 0.16765171536237017}}} #metrics {"StartTime": 1616445766.8012702, "EndTime": 1616445766.8012788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17507755982658002, "count": 1, "min": 0.17507755982658002, "max": 0.17507755982658002}}} #metrics {"StartTime": 1616445766.8013093, "EndTime": 1616445766.8013184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1661733850976857, "count": 1, "min": 0.1661733850976857, "max": 0.1661733850976857}}} #metrics {"StartTime": 1616445766.8013537, "EndTime": 1616445766.8013644, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14229769000394643, "count": 1, "min": 0.14229769000394643, "max": 0.14229769000394643}}} #metrics {"StartTime": 1616445766.8013928, "EndTime": 1616445766.801401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14238562368217333, "count": 1, "min": 0.14238562368217333, "max": 0.14238562368217333}}} #metrics {"StartTime": 1616445766.8014345, "EndTime": 1616445766.8014426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14241517401765122, "count": 1, "min": 0.14241517401765122, "max": 0.14241517401765122}}} #metrics {"StartTime": 1616445766.8014715, "EndTime": 1616445766.8014793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1423674034780489, "count": 1, "min": 0.1423674034780489, "max": 0.1423674034780489}}} #metrics {"StartTime": 1616445766.8015096, "EndTime": 1616445766.801518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18547551884430402, "count": 1, "min": 0.18547551884430402, "max": 0.18547551884430402}}} #metrics {"StartTime": 1616445766.8015516, "EndTime": 1616445766.8015604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1803912776739267, "count": 1, "min": 0.1803912776739267, "max": 0.1803912776739267}}} #metrics {"StartTime": 1616445766.8015919, "EndTime": 1616445766.8015997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1864144040186058, "count": 1, "min": 0.1864144040186058, "max": 0.1864144040186058}}} #metrics {"StartTime": 1616445766.8016295, "EndTime": 1616445766.801638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17951596489988025, "count": 1, "min": 0.17951596489988025, "max": 0.17951596489988025}}} #metrics {"StartTime": 1616445766.8016722, "EndTime": 1616445766.8016818, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17438496198344572, "count": 1, "min": 0.17438496198344572, "max": 0.17438496198344572}}} #metrics {"StartTime": 1616445766.8017151, "EndTime": 1616445766.801725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17518804298767662, "count": 1, "min": 0.17518804298767662, "max": 0.17518804298767662}}} #metrics {"StartTime": 1616445766.801756, "EndTime": 1616445766.8017647, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1743662395819041, "count": 1, "min": 0.1743662395819041, "max": 0.1743662395819041}}} #metrics {"StartTime": 1616445766.8017998, "EndTime": 1616445766.8018107, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17519601588767747, "count": 1, "min": 0.17519601588767747, "max": 0.17519601588767747}}} #metrics {"StartTime": 1616445766.8018422, "EndTime": 1616445766.801851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44442476059753083, "count": 1, "min": 0.44442476059753083, "max": 0.44442476059753083}}} #metrics {"StartTime": 1616445766.8018804, "EndTime": 1616445766.80189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44411818210127424, "count": 1, "min": 0.44411818210127424, "max": 0.44411818210127424}}} #metrics {"StartTime": 1616445766.8019137, "EndTime": 1616445766.8019228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4444626723406732, "count": 1, "min": 0.4444626723406732, "max": 0.4444626723406732}}} #metrics {"StartTime": 1616445766.8019507, "EndTime": 1616445766.8019598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44357801988570217, "count": 1, "min": 0.44357801988570217, "max": 0.44357801988570217}}} #metrics {"StartTime": 1616445766.8019888, "EndTime": 1616445766.801998, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.43991578436921375, "count": 1, "min": 0.43991578436921375, "max": 0.43991578436921375}}} #metrics {"StartTime": 1616445766.8020227, "EndTime": 1616445766.8020322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4506580668813649, "count": 1, "min": 0.4506580668813649, "max": 0.4506580668813649}}} #metrics {"StartTime": 1616445766.8020575, "EndTime": 1616445766.8020668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44061535044682454, "count": 1, "min": 0.44061535044682454, "max": 0.44061535044682454}}} #metrics {"StartTime": 1616445766.8020928, "EndTime": 1616445766.8021011, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45033884229485777, "count": 1, "min": 0.45033884229485777, "max": 0.45033884229485777}}} #metrics {"StartTime": 1616445766.8021343, "EndTime": 1616445766.8021436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842107534958408, "count": 1, "min": 0.6842107534958408, "max": 0.6842107534958408}}} #metrics {"StartTime": 1616445766.8021803, "EndTime": 1616445766.8021896, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6840824029072181, "count": 1, "min": 0.6840824029072181, "max": 0.6840824029072181}}} #metrics {"StartTime": 1616445766.802222, "EndTime": 1616445766.8022316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684183310413479, "count": 1, "min": 0.684183310413479, "max": 0.684183310413479}}} #metrics {"StartTime": 1616445766.8022656, "EndTime": 1616445766.8022757, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838990668106824, "count": 1, "min": 0.6838990668106824, "max": 0.6838990668106824}}} #metrics {"StartTime": 1616445766.8023093, "EndTime": 1616445766.8023188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6830976874984408, "count": 1, "min": 0.6830976874984408, "max": 0.6830976874984408}}} #metrics {"StartTime": 1616445766.8023562, "EndTime": 1616445766.8023665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6876292268117946, "count": 1, "min": 0.6876292268117946, "max": 0.6876292268117946}}} #metrics {"StartTime": 1616445766.8024058, "EndTime": 1616445766.8024142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834755440563604, "count": 1, "min": 0.6834755440563604, "max": 0.6834755440563604}}} #metrics {"StartTime": 1616445766.8024395, "EndTime": 1616445766.8024464, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6872617864008171, "count": 1, "min": 0.6872617864008171, "max": 0.6872617864008171}}} [03/22/2021 20:42:46 INFO 139901614024512] #quality_metric: host=algo-1, epoch=1, validation binary_classification_cross_entropy_objective <loss>=0.1750952926535587 [03/22/2021 20:42:46 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=1, criteria=sampled_accuracy, value=0.9497959907752351 [03/22/2021 20:42:46 INFO 139901614024512] Epoch 1: Loss improved. Updating best model [03/22/2021 20:42:46 INFO 139901614024512] Saving model for epoch: 1 [03/22/2021 20:42:46 INFO 139901614024512] Saved checkpoint to "/tmp/tmpr6jtgpqb/mx-mod-0000.params" [03/22/2021 20:42:46 INFO 139901614024512] #progress_metric: host=algo-1, completed 13.333333333333334 % of epochs #metrics {"StartTime": 1616445755.0644755, "EndTime": 1616445766.8076284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 1, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 913922.0, "count": 1, "min": 913922, "max": 913922}, "Total Batches Seen": {"sum": 914.0, "count": 1, "min": 914, "max": 914}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 4.0, "count": 1, "min": 4, "max": 4}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:42:46 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=38401.687740902904 records/second [2021-03-22 20:42:56.765] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 7, "duration": 9955, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445776.7656424, "EndTime": 1616445776.765715, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16835695185343424, "count": 1, "min": 0.16835695185343424, "max": 0.16835695185343424}}} #metrics {"StartTime": 1616445776.765794, "EndTime": 1616445776.7658088, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1596017068142361, "count": 1, "min": 0.1596017068142361, "max": 0.1596017068142361}}} #metrics {"StartTime": 1616445776.7658508, "EndTime": 1616445776.765862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16833311542087132, "count": 1, "min": 0.16833311542087132, "max": 0.16833311542087132}}} #metrics {"StartTime": 1616445776.7659001, "EndTime": 1616445776.765911, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15843991253323025, "count": 1, "min": 0.15843991253323025, "max": 0.15843991253323025}}} #metrics {"StartTime": 1616445776.7659576, "EndTime": 1616445776.7659698, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13850117062038844, "count": 1, "min": 0.13850117062038844, "max": 0.13850117062038844}}} #metrics {"StartTime": 1616445776.7660167, "EndTime": 1616445776.766028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14076073181152343, "count": 1, "min": 0.14076073181152343, "max": 0.14076073181152343}}} #metrics {"StartTime": 1616445776.7660758, "EndTime": 1616445776.7660851, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1385488912624783, "count": 1, "min": 0.1385488912624783, "max": 0.1385488912624783}}} #metrics {"StartTime": 1616445776.7661135, "EndTime": 1616445776.7661214, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1406552821858724, "count": 1, "min": 0.1406552821858724, "max": 0.1406552821858724}}} #metrics {"StartTime": 1616445776.7661507, "EndTime": 1616445776.766157, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1805904414537218, "count": 1, "min": 0.1805904414537218, "max": 0.1805904414537218}}} #metrics {"StartTime": 1616445776.766177, "EndTime": 1616445776.7661843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17555507873535156, "count": 1, "min": 0.17555507873535156, "max": 0.17555507873535156}}} #metrics {"StartTime": 1616445776.7662125, "EndTime": 1616445776.766219, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.18132122399224176, "count": 1, "min": 0.18132122399224176, "max": 0.18132122399224176}}} #metrics {"StartTime": 1616445776.7662427, "EndTime": 1616445776.7662513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17498404690212674, "count": 1, "min": 0.17498404690212674, "max": 0.17498404690212674}}} #metrics {"StartTime": 1616445776.7662895, "EndTime": 1616445776.7662983, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17277511335584853, "count": 1, "min": 0.17277511335584853, "max": 0.17277511335584853}}} #metrics {"StartTime": 1616445776.7663312, "EndTime": 1616445776.7663398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1746938789537218, "count": 1, "min": 0.1746938789537218, "max": 0.1746938789537218}}} #metrics {"StartTime": 1616445776.766373, "EndTime": 1616445776.7663817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1727767775132921, "count": 1, "min": 0.1727767775132921, "max": 0.1727767775132921}}} #metrics {"StartTime": 1616445776.7664163, "EndTime": 1616445776.7664258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17469458770751953, "count": 1, "min": 0.17469458770751953, "max": 0.17469458770751953}}} #metrics {"StartTime": 1616445776.7664592, "EndTime": 1616445776.766468, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44398480611165364, "count": 1, "min": 0.44398480611165364, "max": 0.44398480611165364}}} #metrics {"StartTime": 1616445776.766501, "EndTime": 1616445776.7665095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44402773810492624, "count": 1, "min": 0.44402773810492624, "max": 0.44402773810492624}}} #metrics {"StartTime": 1616445776.7665415, "EndTime": 1616445776.766551, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44398408182779947, "count": 1, "min": 0.44398408182779947, "max": 0.44398408182779947}}} #metrics {"StartTime": 1616445776.7665854, "EndTime": 1616445776.766595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440259528266059, "count": 1, "min": 0.4440259528266059, "max": 0.4440259528266059}}} #metrics {"StartTime": 1616445776.7666278, "EndTime": 1616445776.7666378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4445520012749566, "count": 1, "min": 0.4445520012749566, "max": 0.4445520012749566}}} #metrics {"StartTime": 1616445776.7666802, "EndTime": 1616445776.7666917, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.445482903781467, "count": 1, "min": 0.445482903781467, "max": 0.445482903781467}}} #metrics {"StartTime": 1616445776.7667315, "EndTime": 1616445776.7667408, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4445600754123264, "count": 1, "min": 0.4445600754123264, "max": 0.4445600754123264}}} #metrics {"StartTime": 1616445776.7667775, "EndTime": 1616445776.7667873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4454710553656684, "count": 1, "min": 0.4454710553656684, "max": 0.4454710553656684}}} #metrics {"StartTime": 1616445776.7668383, "EndTime": 1616445776.7668488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845187310112847, "count": 1, "min": 0.6845187310112847, "max": 0.6845187310112847}}} #metrics {"StartTime": 1616445776.766886, "EndTime": 1616445776.7668955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845746129014757, "count": 1, "min": 0.6845746129014757, "max": 0.6845746129014757}}} #metrics {"StartTime": 1616445776.766933, "EndTime": 1616445776.766942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845196308051216, "count": 1, "min": 0.6845196308051216, "max": 0.6845196308051216}}} #metrics {"StartTime": 1616445776.7669764, "EndTime": 1616445776.766986, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845739596896702, "count": 1, "min": 0.6845739596896702, "max": 0.6845739596896702}}} #metrics {"StartTime": 1616445776.76702, "EndTime": 1616445776.7670302, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6850764048936632, "count": 1, "min": 0.6850764048936632, "max": 0.6850764048936632}}} #metrics {"StartTime": 1616445776.7670658, "EndTime": 1616445776.7670753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863159587944878, "count": 1, "min": 0.6863159587944878, "max": 0.6863159587944878}}} #metrics {"StartTime": 1616445776.7671103, "EndTime": 1616445776.7671201, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6850763136121962, "count": 1, "min": 0.6850763136121962, "max": 0.6850763136121962}}} #metrics {"StartTime": 1616445776.7671554, "EndTime": 1616445776.767165, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863177168782552, "count": 1, "min": 0.6863177168782552, "max": 0.6863177168782552}}} [03/22/2021 20:42:56 INFO 139901614024512] #quality_metric: host=algo-1, epoch=2, train binary_classification_cross_entropy_objective <loss>=0.16835695185343424 [2021-03-22 20:42:57.728] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 8, "duration": 948, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445778.3873065, "EndTime": 1616445778.3873649, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1663499789858025, "count": 1, "min": 0.1663499789858025, "max": 0.1663499789858025}}} #metrics {"StartTime": 1616445778.3874354, "EndTime": 1616445778.3874476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15721316578668632, "count": 1, "min": 0.15721316578668632, "max": 0.15721316578668632}}} #metrics {"StartTime": 1616445778.387484, "EndTime": 1616445778.3874943, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1663329498848637, "count": 1, "min": 0.1663329498848637, "max": 0.1663329498848637}}} #metrics {"StartTime": 1616445778.3875277, "EndTime": 1616445778.3875358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1562993163818879, "count": 1, "min": 0.1562993163818879, "max": 0.1562993163818879}}} #metrics {"StartTime": 1616445778.3875673, "EndTime": 1616445778.3875754, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14163249098537703, "count": 1, "min": 0.14163249098537703, "max": 0.14163249098537703}}} #metrics {"StartTime": 1616445778.3876092, "EndTime": 1616445778.3876197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14223776819521133, "count": 1, "min": 0.14223776819521133, "max": 0.14223776819521133}}} #metrics {"StartTime": 1616445778.3876567, "EndTime": 1616445778.3876672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.141627147093254, "count": 1, "min": 0.141627147093254, "max": 0.141627147093254}}} #metrics {"StartTime": 1616445778.3877013, "EndTime": 1616445778.3877113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1422780587611013, "count": 1, "min": 0.1422780587611013, "max": 0.1422780587611013}}} #metrics {"StartTime": 1616445778.387741, "EndTime": 1616445778.3877501, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17973878463574583, "count": 1, "min": 0.17973878463574583, "max": 0.17973878463574583}}} #metrics {"StartTime": 1616445778.3877811, "EndTime": 1616445778.3877892, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17539511019612153, "count": 1, "min": 0.17539511019612153, "max": 0.17539511019612153}}} #metrics {"StartTime": 1616445778.3878205, "EndTime": 1616445778.3878293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.18036742204466844, "count": 1, "min": 0.18036742204466844, "max": 0.18036742204466844}}} #metrics {"StartTime": 1616445778.3878615, "EndTime": 1616445778.3878691, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17508665575125928, "count": 1, "min": 0.17508665575125928, "max": 0.17508665575125928}}} #metrics {"StartTime": 1616445778.3879066, "EndTime": 1616445778.3879156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17405921092836152, "count": 1, "min": 0.17405921092836152, "max": 0.17405921092836152}}} #metrics {"StartTime": 1616445778.3879478, "EndTime": 1616445778.3879545, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1750457754197729, "count": 1, "min": 0.1750457754197729, "max": 0.1750457754197729}}} #metrics {"StartTime": 1616445778.3879871, "EndTime": 1616445778.387994, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17405759775196594, "count": 1, "min": 0.17405759775196594, "max": 0.17405759775196594}}} #metrics {"StartTime": 1616445778.388026, "EndTime": 1616445778.3880327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17504717299167158, "count": 1, "min": 0.17504717299167158, "max": 0.17504717299167158}}} #metrics {"StartTime": 1616445778.3880641, "EndTime": 1616445778.3880706, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44507461122868436, "count": 1, "min": 0.44507461122868436, "max": 0.44507461122868436}}} #metrics {"StartTime": 1616445778.3881035, "EndTime": 1616445778.38811, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437013380785921, "count": 1, "min": 0.4437013380785921, "max": 0.4437013380785921}}} #metrics {"StartTime": 1616445778.388144, "EndTime": 1616445778.388153, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44489222308814114, "count": 1, "min": 0.44489222308814114, "max": 0.44489222308814114}}} #metrics {"StartTime": 1616445778.388189, "EndTime": 1616445778.388198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4430262694359672, "count": 1, "min": 0.4430262694359672, "max": 0.4430262694359672}}} #metrics {"StartTime": 1616445778.3882303, "EndTime": 1616445778.3882394, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4342584366026089, "count": 1, "min": 0.4342584366026089, "max": 0.4342584366026089}}} #metrics {"StartTime": 1616445778.3882678, "EndTime": 1616445778.388274, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4504723370741377, "count": 1, "min": 0.4504723370741377, "max": 0.4504723370741377}}} #metrics {"StartTime": 1616445778.3882978, "EndTime": 1616445778.3883038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4341643336987863, "count": 1, "min": 0.4341643336987863, "max": 0.4341643336987863}}} #metrics {"StartTime": 1616445778.3883235, "EndTime": 1616445778.3883288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.45062125116158447, "count": 1, "min": 0.45062125116158447, "max": 0.45062125116158447}}} #metrics {"StartTime": 1616445778.3883479, "EndTime": 1616445778.388353, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842322446489156, "count": 1, "min": 0.6842322446489156, "max": 0.6842322446489156}}} #metrics {"StartTime": 1616445778.388372, "EndTime": 1616445778.3883777, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837595145330586, "count": 1, "min": 0.6837595145330586, "max": 0.6837595145330586}}} #metrics {"StartTime": 1616445778.3884113, "EndTime": 1616445778.3884203, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843053447242238, "count": 1, "min": 0.6843053447242238, "max": 0.6843053447242238}}} #metrics {"StartTime": 1616445778.3884578, "EndTime": 1616445778.3884664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838235351280982, "count": 1, "min": 0.6838235351280982, "max": 0.6838235351280982}}} #metrics {"StartTime": 1616445778.3885026, "EndTime": 1616445778.3885124, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821651510848038, "count": 1, "min": 0.6821651510848038, "max": 0.6821651510848038}}} #metrics {"StartTime": 1616445778.3885484, "EndTime": 1616445778.388558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6868532972215696, "count": 1, "min": 0.6868532972215696, "max": 0.6868532972215696}}} #metrics {"StartTime": 1616445778.3885875, "EndTime": 1616445778.3885965, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821334581711792, "count": 1, "min": 0.6821334581711792, "max": 0.6821334581711792}}} #metrics {"StartTime": 1616445778.3886225, "EndTime": 1616445778.388631, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6858401339295613, "count": 1, "min": 0.6858401339295613, "max": 0.6858401339295613}}} [03/22/2021 20:42:58 INFO 139901614024512] #quality_metric: host=algo-1, epoch=2, validation binary_classification_cross_entropy_objective <loss>=0.1663499789858025 [03/22/2021 20:42:58 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=2, criteria=sampled_accuracy, value=0.9497959907752351 [03/22/2021 20:42:58 INFO 139901614024512] Epoch 2: Loss improved. Updating best model [03/22/2021 20:42:58 INFO 139901614024512] Saving model for epoch: 2 [03/22/2021 20:42:58 INFO 139901614024512] Saved checkpoint to "/tmp/tmpr2icdeyr/mx-mod-0000.params" [03/22/2021 20:42:58 INFO 139901614024512] #progress_metric: host=algo-1, completed 20.0 % of epochs #metrics {"StartTime": 1616445766.809989, "EndTime": 1616445778.39403, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 2, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1364883.0, "count": 1, "min": 1364883, "max": 1364883}, "Total Batches Seen": {"sum": 1365.0, "count": 1, "min": 1365, "max": 1365}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 5.0, "count": 1, "min": 5, "max": 5}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:42:58 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=38929.13919134012 records/second [2021-03-22 20:43:09.294] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 9, "duration": 10897, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445789.29457, "EndTime": 1616445789.2946384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1619892241075304, "count": 1, "min": 0.1619892241075304, "max": 0.1619892241075304}}} #metrics {"StartTime": 1616445789.2947109, "EndTime": 1616445789.2947252, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15191869447496203, "count": 1, "min": 0.15191869447496203, "max": 0.15191869447496203}}} #metrics {"StartTime": 1616445789.2947671, "EndTime": 1616445789.294778, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.16196402030097115, "count": 1, "min": 0.16196402030097115, "max": 0.16196402030097115}}} #metrics {"StartTime": 1616445789.2948313, "EndTime": 1616445789.2948427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15113188101874458, "count": 1, "min": 0.15113188101874458, "max": 0.15113188101874458}}} #metrics {"StartTime": 1616445789.2948885, "EndTime": 1616445789.2949004, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13788547341240776, "count": 1, "min": 0.13788547341240776, "max": 0.13788547341240776}}} #metrics {"StartTime": 1616445789.2949462, "EndTime": 1616445789.2949579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14071572045220268, "count": 1, "min": 0.14071572045220268, "max": 0.14071572045220268}}} #metrics {"StartTime": 1616445789.2950077, "EndTime": 1616445789.2950175, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1378987769232856, "count": 1, "min": 0.1378987769232856, "max": 0.1378987769232856}}} #metrics {"StartTime": 1616445789.2950523, "EndTime": 1616445789.2950613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14064922198825414, "count": 1, "min": 0.14064922198825414, "max": 0.14064922198825414}}} #metrics {"StartTime": 1616445789.2950864, "EndTime": 1616445789.295092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17674844821506078, "count": 1, "min": 0.17674844821506078, "max": 0.17674844821506078}}} #metrics {"StartTime": 1616445789.2951136, "EndTime": 1616445789.2951212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17272740593804253, "count": 1, "min": 0.17272740593804253, "max": 0.17272740593804253}}} #metrics {"StartTime": 1616445789.2951438, "EndTime": 1616445789.295149, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1772668049791124, "count": 1, "min": 0.1772668049791124, "max": 0.1772668049791124}}} #metrics {"StartTime": 1616445789.2951684, "EndTime": 1616445789.295176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17254176710340713, "count": 1, "min": 0.17254176710340713, "max": 0.17254176710340713}}} #metrics {"StartTime": 1616445789.2952056, "EndTime": 1616445789.2952144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1724007886420356, "count": 1, "min": 0.1724007886420356, "max": 0.1724007886420356}}} #metrics {"StartTime": 1616445789.295248, "EndTime": 1616445789.295257, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.174633575914171, "count": 1, "min": 0.174633575914171, "max": 0.174633575914171}}} #metrics {"StartTime": 1616445789.295291, "EndTime": 1616445789.2953, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17240124084472655, "count": 1, "min": 0.17240124084472655, "max": 0.17240124084472655}}} #metrics {"StartTime": 1616445789.2953334, "EndTime": 1616445789.2953432, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17463464477539062, "count": 1, "min": 0.17463464477539062, "max": 0.17463464477539062}}} #metrics {"StartTime": 1616445789.2953744, "EndTime": 1616445789.2953837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44395652669270835, "count": 1, "min": 0.44395652669270835, "max": 0.44395652669270835}}} #metrics {"StartTime": 1616445789.29542, "EndTime": 1616445789.2954288, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44402155178493924, "count": 1, "min": 0.44402155178493924, "max": 0.44402155178493924}}} #metrics {"StartTime": 1616445789.2954628, "EndTime": 1616445789.2954717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439610844590929, "count": 1, "min": 0.4439610844590929, "max": 0.4439610844590929}}} #metrics {"StartTime": 1616445789.295506, "EndTime": 1616445789.2955163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440198517523872, "count": 1, "min": 0.4440198517523872, "max": 0.4440198517523872}}} #metrics {"StartTime": 1616445789.2955441, "EndTime": 1616445789.2955534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4443156803385417, "count": 1, "min": 0.4443156803385417, "max": 0.4443156803385417}}} #metrics {"StartTime": 1616445789.295583, "EndTime": 1616445789.2955925, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44547492818196616, "count": 1, "min": 0.44547492818196616, "max": 0.44547492818196616}}} #metrics {"StartTime": 1616445789.2956266, "EndTime": 1616445789.2956367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4443148304578993, "count": 1, "min": 0.4443148304578993, "max": 0.4443148304578993}}} #metrics {"StartTime": 1616445789.2956705, "EndTime": 1616445789.2956803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4454780190700955, "count": 1, "min": 0.4454780190700955, "max": 0.4454780190700955}}} #metrics {"StartTime": 1616445789.2957103, "EndTime": 1616445789.2957196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844959117296007, "count": 1, "min": 0.6844959117296007, "max": 0.6844959117296007}}} #metrics {"StartTime": 1616445789.2957487, "EndTime": 1616445789.2957573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845678489854601, "count": 1, "min": 0.6845678489854601, "max": 0.6845678489854601}}} #metrics {"StartTime": 1616445789.2957897, "EndTime": 1616445789.295799, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684496762017144, "count": 1, "min": 0.684496762017144, "max": 0.684496762017144}}} #metrics {"StartTime": 1616445789.2958362, "EndTime": 1616445789.2958462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845678968641493, "count": 1, "min": 0.6845678968641493, "max": 0.6845678968641493}}} #metrics {"StartTime": 1616445789.2958775, "EndTime": 1616445789.295886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6848593208821615, "count": 1, "min": 0.6848593208821615, "max": 0.6848593208821615}}} #metrics {"StartTime": 1616445789.2959201, "EndTime": 1616445789.2959294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863441061740452, "count": 1, "min": 0.6863441061740452, "max": 0.6863441061740452}}} #metrics {"StartTime": 1616445789.2959638, "EndTime": 1616445789.295973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.68485923570421, "count": 1, "min": 0.68485923570421, "max": 0.68485923570421}}} #metrics {"StartTime": 1616445789.296049, "EndTime": 1616445789.296061, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863373627387153, "count": 1, "min": 0.6863373627387153, "max": 0.6863373627387153}}} [03/22/2021 20:43:09 INFO 139901614024512] #quality_metric: host=algo-1, epoch=3, train binary_classification_cross_entropy_objective <loss>=0.1619892241075304 [2021-03-22 20:43:10.406] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 11, "duration": 1097, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445791.155918, "EndTime": 1616445791.155979, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16202652968264059, "count": 1, "min": 0.16202652968264059, "max": 0.16202652968264059}}} #metrics {"StartTime": 1616445791.1560483, "EndTime": 1616445791.1560585, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15205617894173853, "count": 1, "min": 0.15205617894173853, "max": 0.15205617894173853}}} #metrics {"StartTime": 1616445791.156083, "EndTime": 1616445791.1560907, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.16199842909453754, "count": 1, "min": 0.16199842909453754, "max": 0.16199842909453754}}} #metrics {"StartTime": 1616445791.156124, "EndTime": 1616445791.1561315, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15141255647890403, "count": 1, "min": 0.15141255647890403, "max": 0.15141255647890403}}} #metrics {"StartTime": 1616445791.1561651, "EndTime": 1616445791.1561742, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14086512703833817, "count": 1, "min": 0.14086512703833817, "max": 0.14086512703833817}}} #metrics {"StartTime": 1616445791.156206, "EndTime": 1616445791.156215, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14219478358819762, "count": 1, "min": 0.14219478358819762, "max": 0.14219478358819762}}} #metrics {"StartTime": 1616445791.156248, "EndTime": 1616445791.1562567, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1408728325644008, "count": 1, "min": 0.1408728325644008, "max": 0.1408728325644008}}} #metrics {"StartTime": 1616445791.1563003, "EndTime": 1616445791.1563103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14223201170402447, "count": 1, "min": 0.14223201170402447, "max": 0.14223201170402447}}} #metrics {"StartTime": 1616445791.156347, "EndTime": 1616445791.1563566, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17736943752308443, "count": 1, "min": 0.17736943752308443, "max": 0.17736943752308443}}} #metrics {"StartTime": 1616445791.156392, "EndTime": 1616445791.1563997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17412774439756384, "count": 1, "min": 0.17412774439756384, "max": 0.17412774439756384}}} #metrics {"StartTime": 1616445791.1564302, "EndTime": 1616445791.1564384, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17783346841029501, "count": 1, "min": 0.17783346841029501, "max": 0.17783346841029501}}} #metrics {"StartTime": 1616445791.1564643, "EndTime": 1616445791.156473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17403752880356974, "count": 1, "min": 0.17403752880356974, "max": 0.17403752880356974}}} #metrics {"StartTime": 1616445791.1565013, "EndTime": 1616445791.1565092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17405167235028812, "count": 1, "min": 0.17405167235028812, "max": 0.17405167235028812}}} #metrics {"StartTime": 1616445791.1565452, "EndTime": 1616445791.1565547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17487114579283813, "count": 1, "min": 0.17487114579283813, "max": 0.17487114579283813}}} #metrics {"StartTime": 1616445791.1565845, "EndTime": 1616445791.1565933, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1740571638360733, "count": 1, "min": 0.1740571638360733, "max": 0.1740571638360733}}} #metrics {"StartTime": 1616445791.1566281, "EndTime": 1616445791.1566374, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17487137378139742, "count": 1, "min": 0.17487137378139742, "max": 0.17487137378139742}}} #metrics {"StartTime": 1616445791.156663, "EndTime": 1616445791.156672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4448700294948034, "count": 1, "min": 0.4448700294948034, "max": 0.4448700294948034}}} #metrics {"StartTime": 1616445791.1566978, "EndTime": 1616445791.1567063, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4431311287439227, "count": 1, "min": 0.4431311287439227, "max": 0.4431311287439227}}} #metrics {"StartTime": 1616445791.1567414, "EndTime": 1616445791.15675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4446039941181036, "count": 1, "min": 0.4446039941181036, "max": 0.4446039941181036}}} #metrics {"StartTime": 1616445791.1567845, "EndTime": 1616445791.1567938, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4426457671550692, "count": 1, "min": 0.4426457671550692, "max": 0.4426457671550692}}} #metrics {"StartTime": 1616445791.1568277, "EndTime": 1616445791.1568365, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4388635036812959, "count": 1, "min": 0.4388635036812959, "max": 0.4388635036812959}}} #metrics {"StartTime": 1616445791.1568725, "EndTime": 1616445791.1568794, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44886209928801196, "count": 1, "min": 0.44886209928801196, "max": 0.44886209928801196}}} #metrics {"StartTime": 1616445791.1569057, "EndTime": 1616445791.156914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4385279156202878, "count": 1, "min": 0.4385279156202878, "max": 0.4385279156202878}}} #metrics {"StartTime": 1616445791.1569448, "EndTime": 1616445791.1569533, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4491289556671462, "count": 1, "min": 0.4491289556671462, "max": 0.4491289556671462}}} #metrics {"StartTime": 1616445791.1569774, "EndTime": 1616445791.1569846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843370682258058, "count": 1, "min": 0.6843370682258058, "max": 0.6843370682258058}}} #metrics {"StartTime": 1616445791.1570134, "EndTime": 1616445791.1570213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834933900993851, "count": 1, "min": 0.6834933900993851, "max": 0.6834933900993851}}} #metrics {"StartTime": 1616445791.1570535, "EndTime": 1616445791.1570623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6843735382745976, "count": 1, "min": 0.6843735382745976, "max": 0.6843735382745976}}} #metrics {"StartTime": 1616445791.157095, "EndTime": 1616445791.1571033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838174768176848, "count": 1, "min": 0.6838174768176848, "max": 0.6838174768176848}}} #metrics {"StartTime": 1616445791.1571357, "EndTime": 1616445791.157145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6830875507034646, "count": 1, "min": 0.6830875507034646, "max": 0.6830875507034646}}} #metrics {"StartTime": 1616445791.1571777, "EndTime": 1616445791.1571887, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6851150431488345, "count": 1, "min": 0.6851150431488345, "max": 0.6851150431488345}}} #metrics {"StartTime": 1616445791.1572218, "EndTime": 1616445791.1572316, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6831598430401429, "count": 1, "min": 0.6831598430401429, "max": 0.6831598430401429}}} #metrics {"StartTime": 1616445791.1572597, "EndTime": 1616445791.1572688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6857757871532051, "count": 1, "min": 0.6857757871532051, "max": 0.6857757871532051}}} [03/22/2021 20:43:11 INFO 139901614024512] #quality_metric: host=algo-1, epoch=3, validation binary_classification_cross_entropy_objective <loss>=0.16202652968264059 [03/22/2021 20:43:11 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=3, criteria=sampled_accuracy, value=0.9502749689551181 [03/22/2021 20:43:11 INFO 139901614024512] Epoch 3: Loss improved. Updating best model [03/22/2021 20:43:11 INFO 139901614024512] Saving model for epoch: 3 [03/22/2021 20:43:11 INFO 139901614024512] Saved checkpoint to "/tmp/tmp6rrztp02/mx-mod-0000.params" [03/22/2021 20:43:11 INFO 139901614024512] #progress_metric: host=algo-1, completed 26.666666666666668 % of epochs #metrics {"StartTime": 1616445778.3964396, "EndTime": 1616445791.1626418, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 3, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 1815844.0, "count": 1, "min": 1815844, "max": 1815844}, "Total Batches Seen": {"sum": 1816.0, "count": 1, "min": 1816, "max": 1816}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 6.0, "count": 1, "min": 6, "max": 6}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:43:11 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=35324.30417805264 records/second [2021-03-22 20:43:20.781] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 11, "duration": 9616, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445800.7818162, "EndTime": 1616445800.7818816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15860654052734374, "count": 1, "min": 0.15860654052734374, "max": 0.15860654052734374}}} #metrics {"StartTime": 1616445800.7819693, "EndTime": 1616445800.781985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14776523312038845, "count": 1, "min": 0.14776523312038845, "max": 0.14776523312038845}}} #metrics {"StartTime": 1616445800.782035, "EndTime": 1616445800.7820485, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15855685299343533, "count": 1, "min": 0.15855685299343533, "max": 0.15855685299343533}}} #metrics {"StartTime": 1616445800.7820942, "EndTime": 1616445800.7821047, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1471837530178494, "count": 1, "min": 0.1471837530178494, "max": 0.1471837530178494}}} #metrics {"StartTime": 1616445800.78215, "EndTime": 1616445800.7821617, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1375704453192817, "count": 1, "min": 0.1375704453192817, "max": 0.1375704453192817}}} #metrics {"StartTime": 1616445800.7822065, "EndTime": 1616445800.782218, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1406176997036404, "count": 1, "min": 0.1406176997036404, "max": 0.1406176997036404}}} #metrics {"StartTime": 1616445800.782268, "EndTime": 1616445800.7822776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13758350068834094, "count": 1, "min": 0.13758350068834094, "max": 0.13758350068834094}}} #metrics {"StartTime": 1616445800.7823102, "EndTime": 1616445800.7823188, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14057725996229384, "count": 1, "min": 0.14057725996229384, "max": 0.14057725996229384}}} #metrics {"StartTime": 1616445800.7823513, "EndTime": 1616445800.78236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.175006194797092, "count": 1, "min": 0.175006194797092, "max": 0.175006194797092}}} #metrics {"StartTime": 1616445800.7823908, "EndTime": 1616445800.7823994, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17203089965820312, "count": 1, "min": 0.17203089965820312, "max": 0.17203089965820312}}} #metrics {"StartTime": 1616445800.7824333, "EndTime": 1616445800.7824411, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17540264234754774, "count": 1, "min": 0.17540264234754774, "max": 0.17540264234754774}}} #metrics {"StartTime": 1616445800.7824774, "EndTime": 1616445800.7824867, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1719841005791558, "count": 1, "min": 0.1719841005791558, "max": 0.1719841005791558}}} #metrics {"StartTime": 1616445800.7825215, "EndTime": 1616445800.7825308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.172157741800944, "count": 1, "min": 0.172157741800944, "max": 0.172157741800944}}} #metrics {"StartTime": 1616445800.7825685, "EndTime": 1616445800.782577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17452295613606772, "count": 1, "min": 0.17452295613606772, "max": 0.17452295613606772}}} #metrics {"StartTime": 1616445800.782611, "EndTime": 1616445800.7826207, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17215782135009766, "count": 1, "min": 0.17215782135009766, "max": 0.17215782135009766}}} #metrics {"StartTime": 1616445800.7826552, "EndTime": 1616445800.7826648, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17452354465060763, "count": 1, "min": 0.17452354465060763, "max": 0.17452354465060763}}} #metrics {"StartTime": 1616445800.7827032, "EndTime": 1616445800.782712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439473596869575, "count": 1, "min": 0.4439473596869575, "max": 0.4439473596869575}}} #metrics {"StartTime": 1616445800.7827463, "EndTime": 1616445800.7827556, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44401556613498266, "count": 1, "min": 0.44401556613498266, "max": 0.44401556613498266}}} #metrics {"StartTime": 1616445800.78279, "EndTime": 1616445800.782816, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439498004828559, "count": 1, "min": 0.4439498004828559, "max": 0.4439498004828559}}} #metrics {"StartTime": 1616445800.782857, "EndTime": 1616445800.7828672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44401553446451825, "count": 1, "min": 0.44401553446451825, "max": 0.44401553446451825}}} #metrics {"StartTime": 1616445800.7829025, "EndTime": 1616445800.782912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4441377003309462, "count": 1, "min": 0.4441377003309462, "max": 0.4441377003309462}}} #metrics {"StartTime": 1616445800.782946, "EndTime": 1616445800.7829561, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44541163336859807, "count": 1, "min": 0.44541163336859807, "max": 0.44541163336859807}}} #metrics {"StartTime": 1616445800.7829943, "EndTime": 1616445800.7830038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44413833523220486, "count": 1, "min": 0.44413833523220486, "max": 0.44413833523220486}}} #metrics {"StartTime": 1616445800.7830386, "EndTime": 1616445800.7830486, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44541749111599394, "count": 1, "min": 0.44541749111599394, "max": 0.44541749111599394}}} #metrics {"StartTime": 1616445800.7830822, "EndTime": 1616445800.7830923, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684475592719184, "count": 1, "min": 0.684475592719184, "max": 0.684475592719184}}} #metrics {"StartTime": 1616445800.7831264, "EndTime": 1616445800.7831352, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845613414171007, "count": 1, "min": 0.6845613414171007, "max": 0.6845613414171007}}} #metrics {"StartTime": 1616445800.7831693, "EndTime": 1616445800.7831793, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844760833062066, "count": 1, "min": 0.6844760833062066, "max": 0.6844760833062066}}} #metrics {"StartTime": 1616445800.7832143, "EndTime": 1616445800.7832236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845626778157552, "count": 1, "min": 0.6845626778157552, "max": 0.6845626778157552}}} #metrics {"StartTime": 1616445800.783258, "EndTime": 1616445800.7832677, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847021488444011, "count": 1, "min": 0.6847021488444011, "max": 0.6847021488444011}}} #metrics {"StartTime": 1616445800.7833023, "EndTime": 1616445800.783312, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863342690700955, "count": 1, "min": 0.6863342690700955, "max": 0.6863342690700955}}} #metrics {"StartTime": 1616445800.7833464, "EndTime": 1616445800.783356, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6847027433268229, "count": 1, "min": 0.6847027433268229, "max": 0.6847027433268229}}} #metrics {"StartTime": 1616445800.78339, "EndTime": 1616445800.7833996, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6863315977647569, "count": 1, "min": 0.6863315977647569, "max": 0.6863315977647569}}} [03/22/2021 20:43:20 INFO 139901614024512] #quality_metric: host=algo-1, epoch=4, train binary_classification_cross_entropy_objective <loss>=0.15860654052734374 [2021-03-22 20:43:21.806] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 14, "duration": 1007, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445802.5311897, "EndTime": 1616445802.5312526, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15955704246955454, "count": 1, "min": 0.15955704246955454, "max": 0.15955704246955454}}} #metrics {"StartTime": 1616445802.5313241, "EndTime": 1616445802.5313344, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14902244515086566, "count": 1, "min": 0.14902244515086566, "max": 0.14902244515086566}}} #metrics {"StartTime": 1616445802.531366, "EndTime": 1616445802.5313728, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1595218459490197, "count": 1, "min": 0.1595218459490197, "max": 0.1595218459490197}}} #metrics {"StartTime": 1616445802.5314028, "EndTime": 1616445802.5314114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14852447415024164, "count": 1, "min": 0.14852447415024164, "max": 0.14852447415024164}}} #metrics {"StartTime": 1616445802.5314465, "EndTime": 1616445802.5314548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14043584596567255, "count": 1, "min": 0.14043584596567255, "max": 0.14043584596567255}}} #metrics {"StartTime": 1616445802.5314872, "EndTime": 1616445802.5314941, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1421977110993509, "count": 1, "min": 0.1421977110993509, "max": 0.1421977110993509}}} #metrics {"StartTime": 1616445802.531524, "EndTime": 1616445802.5315318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.140442457160185, "count": 1, "min": 0.140442457160185, "max": 0.140442457160185}}} #metrics {"StartTime": 1616445802.5315602, "EndTime": 1616445802.531568, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14220960785231523, "count": 1, "min": 0.14220960785231523, "max": 0.14220960785231523}}} #metrics {"StartTime": 1616445802.5316026, "EndTime": 1616445802.531611, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17619924824437033, "count": 1, "min": 0.17619924824437033, "max": 0.17619924824437033}}} #metrics {"StartTime": 1616445802.5316365, "EndTime": 1616445802.531642, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17385511690998873, "count": 1, "min": 0.17385511690998873, "max": 0.17385511690998873}}} #metrics {"StartTime": 1616445802.5316658, "EndTime": 1616445802.5316722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17656713955703093, "count": 1, "min": 0.17656713955703093, "max": 0.17656713955703093}}} #metrics {"StartTime": 1616445802.5316975, "EndTime": 1616445802.531703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17383597710463772, "count": 1, "min": 0.17383597710463772, "max": 0.17383597710463772}}} #metrics {"StartTime": 1616445802.5317268, "EndTime": 1616445802.5317347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.173795535426117, "count": 1, "min": 0.173795535426117, "max": 0.173795535426117}}} #metrics {"StartTime": 1616445802.5317674, "EndTime": 1616445802.5317755, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17464622712757055, "count": 1, "min": 0.17464622712757055, "max": 0.17464622712757055}}} #metrics {"StartTime": 1616445802.5318077, "EndTime": 1616445802.531817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1737971345943108, "count": 1, "min": 0.1737971345943108, "max": 0.1737971345943108}}} #metrics {"StartTime": 1616445802.5318503, "EndTime": 1616445802.5318594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17464630021384067, "count": 1, "min": 0.17464630021384067, "max": 0.17464630021384067}}} #metrics {"StartTime": 1616445802.5318937, "EndTime": 1616445802.5319028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4444236453551867, "count": 1, "min": 0.4444236453551867, "max": 0.4444236453551867}}} #metrics {"StartTime": 1616445802.5319393, "EndTime": 1616445802.5319488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44270685617860717, "count": 1, "min": 0.44270685617860717, "max": 0.44270685617860717}}} #metrics {"StartTime": 1616445802.5319865, "EndTime": 1616445802.5319963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4442604112312137, "count": 1, "min": 0.4442604112312137, "max": 0.4442604112312137}}} #metrics {"StartTime": 1616445802.5320385, "EndTime": 1616445802.5320492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44243083884154777, "count": 1, "min": 0.44243083884154777, "max": 0.44243083884154777}}} #metrics {"StartTime": 1616445802.5320883, "EndTime": 1616445802.5320985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44214525938414717, "count": 1, "min": 0.44214525938414717, "max": 0.44214525938414717}}} #metrics {"StartTime": 1616445802.5321302, "EndTime": 1616445802.5321367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44603082813522127, "count": 1, "min": 0.44603082813522127, "max": 0.44603082813522127}}} #metrics {"StartTime": 1616445802.532157, "EndTime": 1616445802.5321622, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4421763140110126, "count": 1, "min": 0.4421763140110126, "max": 0.4421763140110126}}} #metrics {"StartTime": 1616445802.5321836, "EndTime": 1616445802.5321913, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4461327239302682, "count": 1, "min": 0.4461327239302682, "max": 0.4461327239302682}}} #metrics {"StartTime": 1616445802.5322225, "EndTime": 1616445802.5322301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844432409211044, "count": 1, "min": 0.6844432409211044, "max": 0.6844432409211044}}} #metrics {"StartTime": 1616445802.5322628, "EndTime": 1616445802.5322723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834033453783838, "count": 1, "min": 0.6834033453783838, "max": 0.6834033453783838}}} #metrics {"StartTime": 1616445802.532306, "EndTime": 1616445802.5323148, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845127456933022, "count": 1, "min": 0.6845127456933022, "max": 0.6845127456933022}}} #metrics {"StartTime": 1616445802.5323477, "EndTime": 1616445802.5323577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837469726584156, "count": 1, "min": 0.6837469726584156, "max": 0.6837469726584156}}} #metrics {"StartTime": 1616445802.532397, "EndTime": 1616445802.5324068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837042401990338, "count": 1, "min": 0.6837042401990338, "max": 0.6837042401990338}}} #metrics {"StartTime": 1616445802.5324454, "EndTime": 1616445802.5324554, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6862039914891634, "count": 1, "min": 0.6862039914891634, "max": 0.6862039914891634}}} #metrics {"StartTime": 1616445802.5324914, "EndTime": 1616445802.5325012, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835657341378324, "count": 1, "min": 0.6835657341378324, "max": 0.6835657341378324}}} #metrics {"StartTime": 1616445802.5325377, "EndTime": 1616445802.532547, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6852415920255538, "count": 1, "min": 0.6852415920255538, "max": 0.6852415920255538}}} [03/22/2021 20:43:22 INFO 139901614024512] #quality_metric: host=algo-1, epoch=4, validation binary_classification_cross_entropy_objective <loss>=0.15955704246955454 [03/22/2021 20:43:22 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=4, criteria=sampled_accuracy, value=0.950682987404648 [03/22/2021 20:43:22 INFO 139901614024512] Epoch 4: Loss improved. Updating best model [03/22/2021 20:43:22 INFO 139901614024512] Saving model for epoch: 4 [03/22/2021 20:43:22 INFO 139901614024512] Saved checkpoint to "/tmp/tmpdz44msxa/mx-mod-0000.params" [03/22/2021 20:43:22 INFO 139901614024512] #progress_metric: host=algo-1, completed 33.333333333333336 % of epochs #metrics {"StartTime": 1616445791.1650236, "EndTime": 1616445802.5394657, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 4, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2266805.0, "count": 1, "min": 2266805, "max": 2266805}, "Total Batches Seen": {"sum": 2267.0, "count": 1, "min": 2267, "max": 2267}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 7.0, "count": 1, "min": 7, "max": 7}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:43:22 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=39646.46289196096 records/second [2021-03-22 20:43:32.524] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 13, "duration": 9981, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445812.5249233, "EndTime": 1616445812.5249918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1565436400858561, "count": 1, "min": 0.1565436400858561, "max": 0.1565436400858561}}} #metrics {"StartTime": 1616445812.525072, "EndTime": 1616445812.5250869, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14519631256103516, "count": 1, "min": 0.14519631256103516, "max": 0.14519631256103516}}} #metrics {"StartTime": 1616445812.525133, "EndTime": 1616445812.525144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15648636289808485, "count": 1, "min": 0.15648636289808485, "max": 0.15648636289808485}}} #metrics {"StartTime": 1616445812.525186, "EndTime": 1616445812.5251963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14473551596747505, "count": 1, "min": 0.14473551596747505, "max": 0.14473551596747505}}} #metrics {"StartTime": 1616445812.5252397, "EndTime": 1616445812.5252507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13742772706773546, "count": 1, "min": 0.13742772706773546, "max": 0.13742772706773546}}} #metrics {"StartTime": 1616445812.5252962, "EndTime": 1616445812.5253074, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14050168446858724, "count": 1, "min": 0.14050168446858724, "max": 0.14050168446858724}}} #metrics {"StartTime": 1616445812.5253637, "EndTime": 1616445812.5253744, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13743145999484593, "count": 1, "min": 0.13743145999484593, "max": 0.13743145999484593}}} #metrics {"StartTime": 1616445812.5254147, "EndTime": 1616445812.5254247, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14047597018771701, "count": 1, "min": 0.14047597018771701, "max": 0.14047597018771701}}} #metrics {"StartTime": 1616445812.5254595, "EndTime": 1616445812.525468, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17409146742078993, "count": 1, "min": 0.17409146742078993, "max": 0.17409146742078993}}} #metrics {"StartTime": 1616445812.5255, "EndTime": 1616445812.5255082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718863225640191, "count": 1, "min": 0.1718863225640191, "max": 0.1718863225640191}}} #metrics {"StartTime": 1616445812.5255444, "EndTime": 1616445812.5255537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17441435841878256, "count": 1, "min": 0.17441435841878256, "max": 0.17441435841878256}}} #metrics {"StartTime": 1616445812.5255902, "EndTime": 1616445812.5255985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718782460530599, "count": 1, "min": 0.1718782460530599, "max": 0.1718782460530599}}} #metrics {"StartTime": 1616445812.525634, "EndTime": 1616445812.525644, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17200101647271052, "count": 1, "min": 0.17200101647271052, "max": 0.17200101647271052}}} #metrics {"StartTime": 1616445812.5256815, "EndTime": 1616445812.525691, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17440855339898004, "count": 1, "min": 0.17440855339898004, "max": 0.17440855339898004}}} #metrics {"StartTime": 1616445812.5257292, "EndTime": 1616445812.5257392, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17200103139241538, "count": 1, "min": 0.17200103139241538, "max": 0.17200103139241538}}} #metrics {"StartTime": 1616445812.5257757, "EndTime": 1616445812.5257845, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17440887512207032, "count": 1, "min": 0.17440887512207032, "max": 0.17440887512207032}}} #metrics {"StartTime": 1616445812.5258236, "EndTime": 1616445812.5258348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393903076171876, "count": 1, "min": 0.44393903076171876, "max": 0.44393903076171876}}} #metrics {"StartTime": 1616445812.5258737, "EndTime": 1616445812.5258834, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44401136827256943, "count": 1, "min": 0.44401136827256943, "max": 0.44401136827256943}}} #metrics {"StartTime": 1616445812.52592, "EndTime": 1616445812.5259297, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44394041531032985, "count": 1, "min": 0.44394041531032985, "max": 0.44394041531032985}}} #metrics {"StartTime": 1616445812.5259664, "EndTime": 1616445812.5259764, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440118358018663, "count": 1, "min": 0.4440118358018663, "max": 0.4440118358018663}}} #metrics {"StartTime": 1616445812.5260136, "EndTime": 1616445812.5260236, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440642567952474, "count": 1, "min": 0.4440642567952474, "max": 0.4440642567952474}}} #metrics {"StartTime": 1616445812.5260584, "EndTime": 1616445812.5260675, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4453187163628472, "count": 1, "min": 0.4453187163628472, "max": 0.4453187163628472}}} #metrics {"StartTime": 1616445812.5261006, "EndTime": 1616445812.5261095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44406525193956164, "count": 1, "min": 0.44406525193956164, "max": 0.44406525193956164}}} #metrics {"StartTime": 1616445812.5261445, "EndTime": 1616445812.526154, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4453217300754123, "count": 1, "min": 0.4453217300754123, "max": 0.4453217300754123}}} #metrics {"StartTime": 1616445812.5261889, "EndTime": 1616445812.526198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844644071451823, "count": 1, "min": 0.6844644071451823, "max": 0.6844644071451823}}} #metrics {"StartTime": 1616445812.5262356, "EndTime": 1616445812.5262456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845573082139756, "count": 1, "min": 0.6845573082139756, "max": 0.6845573082139756}}} #metrics {"StartTime": 1616445812.5262806, "EndTime": 1616445812.526291, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844636863878039, "count": 1, "min": 0.6844636863878039, "max": 0.6844636863878039}}} #metrics {"StartTime": 1616445812.526334, "EndTime": 1616445812.5263445, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845575640190972, "count": 1, "min": 0.6845575640190972, "max": 0.6845575640190972}}} #metrics {"StartTime": 1616445812.5263767, "EndTime": 1616445812.526387, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6846580612521701, "count": 1, "min": 0.6846580612521701, "max": 0.6846580612521701}}} #metrics {"StartTime": 1616445812.5264223, "EndTime": 1616445812.5264325, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862787211100261, "count": 1, "min": 0.6862787211100261, "max": 0.6862787211100261}}} #metrics {"StartTime": 1616445812.526468, "EndTime": 1616445812.5264785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6846568004014757, "count": 1, "min": 0.6846568004014757, "max": 0.6846568004014757}}} #metrics {"StartTime": 1616445812.5265117, "EndTime": 1616445812.5265212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6862763690863716, "count": 1, "min": 0.6862763690863716, "max": 0.6862763690863716}}} [03/22/2021 20:43:32 INFO 139901614024512] #quality_metric: host=algo-1, epoch=5, train binary_classification_cross_entropy_objective <loss>=0.1565436400858561 [2021-03-22 20:43:33.557] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 17, "duration": 1017, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445814.189118, "EndTime": 1616445814.1891763, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1580216785895818, "count": 1, "min": 0.1580216785895818, "max": 0.1580216785895818}}} #metrics {"StartTime": 1616445814.189246, "EndTime": 1616445814.189256, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14700931442826484, "count": 1, "min": 0.14700931442826484, "max": 0.14700931442826484}}} #metrics {"StartTime": 1616445814.1892805, "EndTime": 1616445814.1892865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1579789833500598, "count": 1, "min": 0.1579789833500598, "max": 0.1579789833500598}}} #metrics {"StartTime": 1616445814.1893213, "EndTime": 1616445814.1893299, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14659685138609682, "count": 1, "min": 0.14659685138609682, "max": 0.14659685138609682}}} #metrics {"StartTime": 1616445814.1893642, "EndTime": 1616445814.1893718, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14029346538474, "count": 1, "min": 0.14029346538474, "max": 0.14029346538474}}} #metrics {"StartTime": 1616445814.189405, "EndTime": 1616445814.1894114, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14217589430633917, "count": 1, "min": 0.14217589430633917, "max": 0.14217589430633917}}} #metrics {"StartTime": 1616445814.1894338, "EndTime": 1616445814.189441, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1403006674952809, "count": 1, "min": 0.1403006674952809, "max": 0.1403006674952809}}} #metrics {"StartTime": 1616445814.189469, "EndTime": 1616445814.1894774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1421767715445981, "count": 1, "min": 0.1421767715445981, "max": 0.1421767715445981}}} #metrics {"StartTime": 1616445814.1895084, "EndTime": 1616445814.189515, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17554948193311734, "count": 1, "min": 0.17554948193311734, "max": 0.17554948193311734}}} #metrics {"StartTime": 1616445814.1895351, "EndTime": 1616445814.1895404, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17382227329364455, "count": 1, "min": 0.17382227329364455, "max": 0.17382227329364455}}} #metrics {"StartTime": 1616445814.1895597, "EndTime": 1616445814.1895666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1758577878369028, "count": 1, "min": 0.1758577878369028, "max": 0.1758577878369028}}} #metrics {"StartTime": 1616445814.1895998, "EndTime": 1616445814.1896083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17382072237592355, "count": 1, "min": 0.17382072237592355, "max": 0.17382072237592355}}} #metrics {"StartTime": 1616445814.1896443, "EndTime": 1616445814.1896539, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1737416429639772, "count": 1, "min": 0.1737416429639772, "max": 0.1737416429639772}}} #metrics {"StartTime": 1616445814.1896899, "EndTime": 1616445814.1897, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17445241113662383, "count": 1, "min": 0.17445241113662383, "max": 0.17445241113662383}}} #metrics {"StartTime": 1616445814.1897354, "EndTime": 1616445814.1897454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17374268965410683, "count": 1, "min": 0.17374268965410683, "max": 0.17374268965410683}}} #metrics {"StartTime": 1616445814.1897807, "EndTime": 1616445814.1897902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17445205876606035, "count": 1, "min": 0.17445205876606035, "max": 0.17445205876606035}}} #metrics {"StartTime": 1616445814.1898274, "EndTime": 1616445814.189837, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4441919613375147, "count": 1, "min": 0.4441919613375147, "max": 0.4441919613375147}}} #metrics {"StartTime": 1616445814.1898706, "EndTime": 1616445814.1898792, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44241210926672403, "count": 1, "min": 0.44241210926672403, "max": 0.44241210926672403}}} #metrics {"StartTime": 1616445814.18992, "EndTime": 1616445814.1899304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44408877218617643, "count": 1, "min": 0.44408877218617643, "max": 0.44408877218617643}}} #metrics {"StartTime": 1616445814.1899633, "EndTime": 1616445814.1899729, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44228945318130347, "count": 1, "min": 0.44228945318130347, "max": 0.44228945318130347}}} #metrics {"StartTime": 1616445814.1900022, "EndTime": 1616445814.1900117, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44262247537285043, "count": 1, "min": 0.44262247537285043, "max": 0.44262247537285043}}} #metrics {"StartTime": 1616445814.190048, "EndTime": 1616445814.190057, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4447757687787754, "count": 1, "min": 0.4447757687787754, "max": 0.4447757687787754}}} #metrics {"StartTime": 1616445814.1900938, "EndTime": 1616445814.1901038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44257271066083326, "count": 1, "min": 0.44257271066083326, "max": 0.44257271066083326}}} #metrics {"StartTime": 1616445814.1901371, "EndTime": 1616445814.1901472, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4448073087526125, "count": 1, "min": 0.4448073087526125, "max": 0.4448073087526125}}} #metrics {"StartTime": 1616445814.190176, "EndTime": 1616445814.1901853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844510324588794, "count": 1, "min": 0.6844510324588794, "max": 0.6844510324588794}}} #metrics {"StartTime": 1616445814.1902163, "EndTime": 1616445814.1902254, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834247507227637, "count": 1, "min": 0.6834247507227637, "max": 0.6834247507227637}}} #metrics {"StartTime": 1616445814.190257, "EndTime": 1616445814.190266, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845439597565125, "count": 1, "min": 0.6845439597565125, "max": 0.6845439597565125}}} #metrics {"StartTime": 1616445814.190297, "EndTime": 1616445814.1903055, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6836693174136494, "count": 1, "min": 0.6836693174136494, "max": 0.6836693174136494}}} #metrics {"StartTime": 1616445814.1903372, "EndTime": 1616445814.1903455, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6837921072198754, "count": 1, "min": 0.6837921072198754, "max": 0.6837921072198754}}} #metrics {"StartTime": 1616445814.1903775, "EndTime": 1616445814.1903865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6839829977298431, "count": 1, "min": 0.6839829977298431, "max": 0.6839829977298431}}} #metrics {"StartTime": 1616445814.1904204, "EndTime": 1616445814.1904266, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.683850119852821, "count": 1, "min": 0.683850119852821, "max": 0.683850119852821}}} #metrics {"StartTime": 1616445814.1904597, "EndTime": 1616445814.190469, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6840079236669238, "count": 1, "min": 0.6840079236669238, "max": 0.6840079236669238}}} [03/22/2021 20:43:34 INFO 139901614024512] #quality_metric: host=algo-1, epoch=5, validation binary_classification_cross_entropy_objective <loss>=0.1580216785895818 [03/22/2021 20:43:34 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=5, criteria=sampled_accuracy, value=0.9506297676068832 [03/22/2021 20:43:34 INFO 139901614024512] Epoch 5: Loss improved. Updating best model [03/22/2021 20:43:34 INFO 139901614024512] Saving model for epoch: 5 [03/22/2021 20:43:34 INFO 139901614024512] Saved checkpoint to "/tmp/tmpu4lb_f28/mx-mod-0000.params" [03/22/2021 20:43:34 INFO 139901614024512] #progress_metric: host=algo-1, completed 40.0 % of epochs #metrics {"StartTime": 1616445802.5430381, "EndTime": 1616445814.1954727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 5, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 2717766.0, "count": 1, "min": 2717766, "max": 2717766}, "Total Batches Seen": {"sum": 2718.0, "count": 1, "min": 2718, "max": 2718}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 8.0, "count": 1, "min": 8, "max": 8}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:43:34 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=38700.634153852014 records/second [2021-03-22 20:43:44.098] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 15, "duration": 9902, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445824.098821, "EndTime": 1616445824.0988972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15522603990342881, "count": 1, "min": 0.15522603990342881, "max": 0.15522603990342881}}} #metrics {"StartTime": 1616445824.0989711, "EndTime": 1616445824.0989847, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14343477038913302, "count": 1, "min": 0.14343477038913302, "max": 0.14343477038913302}}} #metrics {"StartTime": 1616445824.099026, "EndTime": 1616445824.0990365, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15516427524142795, "count": 1, "min": 0.15516427524142795, "max": 0.15516427524142795}}} #metrics {"StartTime": 1616445824.099074, "EndTime": 1616445824.0990846, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14305284827338324, "count": 1, "min": 0.14305284827338324, "max": 0.14305284827338324}}} #metrics {"StartTime": 1616445824.0991237, "EndTime": 1616445824.0991347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13731205778333877, "count": 1, "min": 0.13731205778333877, "max": 0.13731205778333877}}} #metrics {"StartTime": 1616445824.0991752, "EndTime": 1616445824.0991848, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1403738159688314, "count": 1, "min": 0.1403738159688314, "max": 0.1403738159688314}}} #metrics {"StartTime": 1616445824.0992222, "EndTime": 1616445824.0992324, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13731492892795139, "count": 1, "min": 0.13731492892795139, "max": 0.13731492892795139}}} #metrics {"StartTime": 1616445824.0992706, "EndTime": 1616445824.0992806, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1403573893907335, "count": 1, "min": 0.1403573893907335, "max": 0.1403573893907335}}} #metrics {"StartTime": 1616445824.099318, "EndTime": 1616445824.0993276, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1735630270046658, "count": 1, "min": 0.1735630270046658, "max": 0.1735630270046658}}} #metrics {"StartTime": 1616445824.0993645, "EndTime": 1616445824.0993724, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.171861058722602, "count": 1, "min": 0.171861058722602, "max": 0.171861058722602}}} #metrics {"StartTime": 1616445824.0994105, "EndTime": 1616445824.099421, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17383873406304254, "count": 1, "min": 0.17383873406304254, "max": 0.17383873406304254}}} #metrics {"StartTime": 1616445824.0994604, "EndTime": 1616445824.0994706, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17186070709228515, "count": 1, "min": 0.17186070709228515, "max": 0.17186070709228515}}} #metrics {"StartTime": 1616445824.0995078, "EndTime": 1616445824.099519, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17191412974039713, "count": 1, "min": 0.17191412974039713, "max": 0.17191412974039713}}} #metrics {"StartTime": 1616445824.0995586, "EndTime": 1616445824.0995693, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17428613301595053, "count": 1, "min": 0.17428613301595053, "max": 0.17428613301595053}}} #metrics {"StartTime": 1616445824.0996075, "EndTime": 1616445824.0996172, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17191412550184462, "count": 1, "min": 0.17191412550184462, "max": 0.17191412550184462}}} #metrics {"StartTime": 1616445824.099661, "EndTime": 1616445824.0996716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17428626925998264, "count": 1, "min": 0.17428626925998264, "max": 0.17428626925998264}}} #metrics {"StartTime": 1616445824.0997155, "EndTime": 1616445824.0997267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439353516981337, "count": 1, "min": 0.4439353516981337, "max": 0.4439353516981337}}} #metrics {"StartTime": 1616445824.0997694, "EndTime": 1616445824.09978, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440084329562717, "count": 1, "min": 0.4440084329562717, "max": 0.4440084329562717}}} #metrics {"StartTime": 1616445824.0998228, "EndTime": 1616445824.0998333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393653849283854, "count": 1, "min": 0.44393653849283854, "max": 0.44393653849283854}}} #metrics {"StartTime": 1616445824.0998769, "EndTime": 1616445824.0998876, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44400908854166665, "count": 1, "min": 0.44400908854166665, "max": 0.44400908854166665}}} #metrics {"StartTime": 1616445824.0999305, "EndTime": 1616445824.099941, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44402797336154515, "count": 1, "min": 0.44402797336154515, "max": 0.44402797336154515}}} #metrics {"StartTime": 1616445824.0999851, "EndTime": 1616445824.0999985, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44523285163031684, "count": 1, "min": 0.44523285163031684, "max": 0.44523285163031684}}} #metrics {"StartTime": 1616445824.100043, "EndTime": 1616445824.1000538, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440276622856988, "count": 1, "min": 0.4440276622856988, "max": 0.4440276622856988}}} #metrics {"StartTime": 1616445824.1000967, "EndTime": 1616445824.1001084, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4452340387641059, "count": 1, "min": 0.4452340387641059, "max": 0.4452340387641059}}} #metrics {"StartTime": 1616445824.1001518, "EndTime": 1616445824.1001623, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844563845486111, "count": 1, "min": 0.6844563845486111, "max": 0.6844563845486111}}} #metrics {"StartTime": 1616445824.1002069, "EndTime": 1616445824.1002176, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845534031846788, "count": 1, "min": 0.6845534031846788, "max": 0.6845534031846788}}} #metrics {"StartTime": 1616445824.10026, "EndTime": 1616445824.1002717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844562114800348, "count": 1, "min": 0.6844562114800348, "max": 0.6844562114800348}}} #metrics {"StartTime": 1616445824.100315, "EndTime": 1616445824.1003263, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845514887152778, "count": 1, "min": 0.6845514887152778, "max": 0.6845514887152778}}} #metrics {"StartTime": 1616445824.1003664, "EndTime": 1616445824.1003776, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845847459581164, "count": 1, "min": 0.6845847459581164, "max": 0.6845847459581164}}} #metrics {"StartTime": 1616445824.1004217, "EndTime": 1616445824.1004329, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861691647677951, "count": 1, "min": 0.6861691647677951, "max": 0.6861691647677951}}} #metrics {"StartTime": 1616445824.1004703, "EndTime": 1616445824.1004815, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845857861328125, "count": 1, "min": 0.6845857861328125, "max": 0.6845857861328125}}} #metrics {"StartTime": 1616445824.1005194, "EndTime": 1616445824.1005294, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6861689624023437, "count": 1, "min": 0.6861689624023437, "max": 0.6861689624023437}}} [03/22/2021 20:43:44 INFO 139901614024512] #quality_metric: host=algo-1, epoch=6, train binary_classification_cross_entropy_objective <loss>=0.15522603990342881 [2021-03-22 20:43:45.122] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 20, "duration": 1008, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445825.752903, "EndTime": 1616445825.7529569, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15702112707788055, "count": 1, "min": 0.15702112707788055, "max": 0.15702112707788055}}} #metrics {"StartTime": 1616445825.7530224, "EndTime": 1616445825.7530324, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1455401687391984, "count": 1, "min": 0.1455401687391984, "max": 0.1455401687391984}}} #metrics {"StartTime": 1616445825.7530642, "EndTime": 1616445825.7530727, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1569732394649011, "count": 1, "min": 0.1569732394649011, "max": 0.1569732394649011}}} #metrics {"StartTime": 1616445825.7531018, "EndTime": 1616445825.7531102, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14518862790792403, "count": 1, "min": 0.14518862790792403, "max": 0.14518862790792403}}} #metrics {"StartTime": 1616445825.7531455, "EndTime": 1616445825.7531548, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14010677557582019, "count": 1, "min": 0.14010677557582019, "max": 0.14010677557582019}}} #metrics {"StartTime": 1616445825.7531848, "EndTime": 1616445825.7531936, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1420862863434742, "count": 1, "min": 0.1420862863434742, "max": 0.1420862863434742}}} #metrics {"StartTime": 1616445825.7532275, "EndTime": 1616445825.7532372, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1401088228711258, "count": 1, "min": 0.1401088228711258, "max": 0.1401088228711258}}} #metrics {"StartTime": 1616445825.7532706, "EndTime": 1616445825.75328, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14208040533493824, "count": 1, "min": 0.14208040533493824, "max": 0.14208040533493824}}} #metrics {"StartTime": 1616445825.7533107, "EndTime": 1616445825.753322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17515831555333863, "count": 1, "min": 0.17515831555333863, "max": 0.17515831555333863}}} #metrics {"StartTime": 1616445825.7533545, "EndTime": 1616445825.7533636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17383571927251812, "count": 1, "min": 0.17383571927251812, "max": 0.17383571927251812}}} #metrics {"StartTime": 1616445825.7533972, "EndTime": 1616445825.753407, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17542633718477404, "count": 1, "min": 0.17542633718477404, "max": 0.17542633718477404}}} #metrics {"StartTime": 1616445825.753438, "EndTime": 1616445825.7534475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17383801506114213, "count": 1, "min": 0.17383801506114213, "max": 0.17383801506114213}}} #metrics {"StartTime": 1616445825.7534766, "EndTime": 1616445825.7534862, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17387593242109975, "count": 1, "min": 0.17387593242109975, "max": 0.17387593242109975}}} #metrics {"StartTime": 1616445825.7535176, "EndTime": 1616445825.7535264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421453035065992, "count": 1, "min": 0.17421453035065992, "max": 0.17421453035065992}}} #metrics {"StartTime": 1616445825.7535644, "EndTime": 1616445825.7535737, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1738763900223577, "count": 1, "min": 0.1738763900223577, "max": 0.1738763900223577}}} #metrics {"StartTime": 1616445825.753599, "EndTime": 1616445825.7536082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17421394735231074, "count": 1, "min": 0.17421394735231074, "max": 0.17421394735231074}}} #metrics {"StartTime": 1616445825.753634, "EndTime": 1616445825.7536435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4440016982867106, "count": 1, "min": 0.4440016982867106, "max": 0.4440016982867106}}} #metrics {"StartTime": 1616445825.7536705, "EndTime": 1616445825.7536786, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4423051818880139, "count": 1, "min": 0.4423051818880139, "max": 0.4423051818880139}}} #metrics {"StartTime": 1616445825.7537124, "EndTime": 1616445825.7537212, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4439414153776631, "count": 1, "min": 0.4439414153776631, "max": 0.4439414153776631}}} #metrics {"StartTime": 1616445825.7537582, "EndTime": 1616445825.7537682, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4422581522266387, "count": 1, "min": 0.4422581522266387, "max": 0.4422581522266387}}} #metrics {"StartTime": 1616445825.7538028, "EndTime": 1616445825.7538128, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44220353675180446, "count": 1, "min": 0.44220353675180446, "max": 0.44220353675180446}}} #metrics {"StartTime": 1616445825.7538478, "EndTime": 1616445825.7538579, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44350256399628707, "count": 1, "min": 0.44350256399628707, "max": 0.44350256399628707}}} #metrics {"StartTime": 1616445825.7538936, "EndTime": 1616445825.7539036, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44216721883073057, "count": 1, "min": 0.44216721883073057, "max": 0.44216721883073057}}} #metrics {"StartTime": 1616445825.7539408, "EndTime": 1616445825.7539499, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44351739184704575, "count": 1, "min": 0.44351739184704575, "max": 0.44351739184704575}}} #metrics {"StartTime": 1616445825.7539866, "EndTime": 1616445825.7539947, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845644683052889, "count": 1, "min": 0.6845644683052889, "max": 0.6845644683052889}}} #metrics {"StartTime": 1616445825.7540193, "EndTime": 1616445825.7540278, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6832995073833807, "count": 1, "min": 0.6832995073833807, "max": 0.6832995073833807}}} #metrics {"StartTime": 1616445825.754062, "EndTime": 1616445825.7540705, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845747025486254, "count": 1, "min": 0.6845747025486254, "max": 0.6845747025486254}}} #metrics {"StartTime": 1616445825.7541022, "EndTime": 1616445825.754112, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6836676310156389, "count": 1, "min": 0.6836676310156389, "max": 0.6836676310156389}}} #metrics {"StartTime": 1616445825.7541447, "EndTime": 1616445825.7541533, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.68370194962119, "count": 1, "min": 0.68370194962119, "max": 0.68370194962119}}} #metrics {"StartTime": 1616445825.754186, "EndTime": 1616445825.754194, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6865746866753704, "count": 1, "min": 0.6865746866753704, "max": 0.6865746866753704}}} #metrics {"StartTime": 1616445825.754231, "EndTime": 1616445825.7542393, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.683745153893049, "count": 1, "min": 0.683745153893049, "max": 0.683745153893049}}} #metrics {"StartTime": 1616445825.7542703, "EndTime": 1616445825.7542791, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6865735162122888, "count": 1, "min": 0.6865735162122888, "max": 0.6865735162122888}}} [03/22/2021 20:43:45 INFO 139901614024512] #quality_metric: host=algo-1, epoch=6, validation binary_classification_cross_entropy_objective <loss>=0.15702112707788055 [03/22/2021 20:43:45 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=6, criteria=sampled_accuracy, value=0.9507716870675892 [03/22/2021 20:43:45 INFO 139901614024512] Epoch 6: Loss improved. Updating best model [03/22/2021 20:43:45 INFO 139901614024512] Saving model for epoch: 6 [03/22/2021 20:43:45 INFO 139901614024512] Saved checkpoint to "/tmp/tmp76wphvod/mx-mod-0000.params" [03/22/2021 20:43:45 INFO 139901614024512] #progress_metric: host=algo-1, completed 46.666666666666664 % of epochs #metrics {"StartTime": 1616445814.1957545, "EndTime": 1616445825.7595928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 6, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3168727.0, "count": 1, "min": 3168727, "max": 3168727}, "Total Batches Seen": {"sum": 3169.0, "count": 1, "min": 3169, "max": 3169}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 9.0, "count": 1, "min": 9, "max": 9}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:43:45 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=38997.1465957494 records/second [2021-03-22 20:43:55.709] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 17, "duration": 9947, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445835.71004, "EndTime": 1616445835.710113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15435391532050238, "count": 1, "min": 0.15435391532050238, "max": 0.15435391532050238}}} #metrics {"StartTime": 1616445835.7101946, "EndTime": 1616445835.7102094, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14214783618503146, "count": 1, "min": 0.14214783618503146, "max": 0.14214783618503146}}} #metrics {"StartTime": 1616445835.710248, "EndTime": 1616445835.7102573, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15428957916259767, "count": 1, "min": 0.15428957916259767, "max": 0.15428957916259767}}} #metrics {"StartTime": 1616445835.7102914, "EndTime": 1616445835.7103016, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14181900317721896, "count": 1, "min": 0.14181900317721896, "max": 0.14181900317721896}}} #metrics {"StartTime": 1616445835.7103364, "EndTime": 1616445835.7103455, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13722368257310655, "count": 1, "min": 0.13722368257310655, "max": 0.13722368257310655}}} #metrics {"StartTime": 1616445835.7103813, "EndTime": 1616445835.710391, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1402423633151584, "count": 1, "min": 0.1402423633151584, "max": 0.1402423633151584}}} #metrics {"StartTime": 1616445835.710426, "EndTime": 1616445835.7104354, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13722611711290147, "count": 1, "min": 0.13722611711290147, "max": 0.13722611711290147}}} #metrics {"StartTime": 1616445835.7104685, "EndTime": 1616445835.7104836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14023211856418186, "count": 1, "min": 0.14023211856418186, "max": 0.14023211856418186}}} #metrics {"StartTime": 1616445835.7105176, "EndTime": 1616445835.710527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17323695980495876, "count": 1, "min": 0.17323695980495876, "max": 0.17323695980495876}}} #metrics {"StartTime": 1616445835.7105598, "EndTime": 1616445835.7105684, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718566766696506, "count": 1, "min": 0.1718566766696506, "max": 0.1718566766696506}}} #metrics {"StartTime": 1616445835.7106016, "EndTime": 1616445835.7106109, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1734800084092882, "count": 1, "min": 0.1734800084092882, "max": 0.1734800084092882}}} #metrics {"StartTime": 1616445835.7106457, "EndTime": 1616445835.7106557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718572486368815, "count": 1, "min": 0.1718572486368815, "max": 0.1718572486368815}}} #metrics {"StartTime": 1616445835.7106917, "EndTime": 1616445835.710702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184884484185112, "count": 1, "min": 0.17184884484185112, "max": 0.17184884484185112}}} #metrics {"StartTime": 1616445835.7107353, "EndTime": 1616445835.7107453, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17417100141737196, "count": 1, "min": 0.17417100141737196, "max": 0.17417100141737196}}} #metrics {"StartTime": 1616445835.7107801, "EndTime": 1616445835.7107902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184890394422744, "count": 1, "min": 0.17184890394422744, "max": 0.17184890394422744}}} #metrics {"StartTime": 1616445835.7108421, "EndTime": 1616445835.710853, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17417105217827691, "count": 1, "min": 0.17417105217827691, "max": 0.17417105217827691}}} #metrics {"StartTime": 1616445835.7108889, "EndTime": 1616445835.7108986, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393644544813365, "count": 1, "min": 0.44393644544813365, "max": 0.44393644544813365}}} #metrics {"StartTime": 1616445835.7109356, "EndTime": 1616445835.7109454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440060413275825, "count": 1, "min": 0.4440060413275825, "max": 0.4440060413275825}}} #metrics {"StartTime": 1616445835.7109807, "EndTime": 1616445835.7109911, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393689514160156, "count": 1, "min": 0.44393689514160156, "max": 0.44393689514160156}}} #metrics {"StartTime": 1616445835.711026, "EndTime": 1616445835.7110362, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44400649495442707, "count": 1, "min": 0.44400649495442707, "max": 0.44400649495442707}}} #metrics {"StartTime": 1616445835.7110717, "EndTime": 1616445835.711082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399653401692707, "count": 1, "min": 0.44399653401692707, "max": 0.44399653401692707}}} #metrics {"StartTime": 1616445835.7111163, "EndTime": 1616445835.7111256, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4451623449028863, "count": 1, "min": 0.4451623449028863, "max": 0.4451623449028863}}} #metrics {"StartTime": 1616445835.7111607, "EndTime": 1616445835.711171, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.443996793484158, "count": 1, "min": 0.443996793484158, "max": 0.443996793484158}}} #metrics {"StartTime": 1616445835.7112062, "EndTime": 1616445835.711216, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4451628180609809, "count": 1, "min": 0.4451628180609809, "max": 0.4451628180609809}}} #metrics {"StartTime": 1616445835.7112484, "EndTime": 1616445835.711258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844511177571615, "count": 1, "min": 0.6844511177571615, "max": 0.6844511177571615}}} #metrics {"StartTime": 1616445835.7112916, "EndTime": 1616445835.7113008, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845492591688368, "count": 1, "min": 0.6845492591688368, "max": 0.6845492591688368}}} #metrics {"StartTime": 1616445835.7113361, "EndTime": 1616445835.7113454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844513077799479, "count": 1, "min": 0.6844513077799479, "max": 0.6844513077799479}}} #metrics {"StartTime": 1616445835.7113802, "EndTime": 1616445835.71139, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845475809733073, "count": 1, "min": 0.6845475809733073, "max": 0.6845475809733073}}} #metrics {"StartTime": 1616445835.7114213, "EndTime": 1616445835.7114303, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845355810546875, "count": 1, "min": 0.6845355810546875, "max": 0.6845355810546875}}} #metrics {"StartTime": 1616445835.711473, "EndTime": 1616445835.7114825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860800421820746, "count": 1, "min": 0.6860800421820746, "max": 0.6860800421820746}}} #metrics {"StartTime": 1616445835.7115197, "EndTime": 1616445835.7115295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845354903157552, "count": 1, "min": 0.6845354903157552, "max": 0.6845354903157552}}} #metrics {"StartTime": 1616445835.711555, "EndTime": 1616445835.711564, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860799594455295, "count": 1, "min": 0.6860799594455295, "max": 0.6860799594455295}}} [03/22/2021 20:43:55 INFO 139901614024512] #quality_metric: host=algo-1, epoch=7, train binary_classification_cross_entropy_objective <loss>=0.15435391532050238 [2021-03-22 20:43:56.587] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 23, "duration": 862, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445837.2406907, "EndTime": 1616445837.2407513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15634831713936484, "count": 1, "min": 0.15634831713936484, "max": 0.15634831713936484}}} #metrics {"StartTime": 1616445837.2408202, "EndTime": 1616445837.240832, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14441491120754457, "count": 1, "min": 0.14441491120754457, "max": 0.14441491120754457}}} #metrics {"StartTime": 1616445837.24087, "EndTime": 1616445837.2408805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1562981996507494, "count": 1, "min": 0.1562981996507494, "max": 0.1562981996507494}}} #metrics {"StartTime": 1616445837.240913, "EndTime": 1616445837.2409234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14411079131988044, "count": 1, "min": 0.14411079131988044, "max": 0.14411079131988044}}} #metrics {"StartTime": 1616445837.2409549, "EndTime": 1616445837.2409658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13989888499640438, "count": 1, "min": 0.13989888499640438, "max": 0.13989888499640438}}} #metrics {"StartTime": 1616445837.2409937, "EndTime": 1616445837.241001, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14197491240962423, "count": 1, "min": 0.14197491240962423, "max": 0.14197491240962423}}} #metrics {"StartTime": 1616445837.241031, "EndTime": 1616445837.2410388, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13990167736563042, "count": 1, "min": 0.13990167736563042, "max": 0.13990167736563042}}} #metrics {"StartTime": 1616445837.2410688, "EndTime": 1616445837.2410774, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14197019489390517, "count": 1, "min": 0.14197019489390517, "max": 0.14197019489390517}}} #metrics {"StartTime": 1616445837.2411113, "EndTime": 1616445837.2411199, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1749096589412422, "count": 1, "min": 0.1749096589412422, "max": 0.1749096589412422}}} #metrics {"StartTime": 1616445837.241153, "EndTime": 1616445837.2411628, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17385459380177756, "count": 1, "min": 0.17385459380177756, "max": 0.17385459380177756}}} #metrics {"StartTime": 1616445837.241198, "EndTime": 1616445837.2412071, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1751500356910033, "count": 1, "min": 0.1751500356910033, "max": 0.1751500356910033}}} #metrics {"StartTime": 1616445837.241241, "EndTime": 1616445837.2412505, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17385783152354403, "count": 1, "min": 0.17385783152354403, "max": 0.17385783152354403}}} #metrics {"StartTime": 1616445837.241289, "EndTime": 1616445837.241299, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17390432190298716, "count": 1, "min": 0.17390432190298716, "max": 0.17390432190298716}}} #metrics {"StartTime": 1616445837.241336, "EndTime": 1616445837.241346, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1740740556295658, "count": 1, "min": 0.1740740556295658, "max": 0.1740740556295658}}} #metrics {"StartTime": 1616445837.2413845, "EndTime": 1616445837.2413948, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17390418303907393, "count": 1, "min": 0.17390418303907393, "max": 0.17390418303907393}}} #metrics {"StartTime": 1616445837.2414348, "EndTime": 1616445837.2414448, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1740734513820603, "count": 1, "min": 0.1740734513820603, "max": 0.1740734513820603}}} #metrics {"StartTime": 1616445837.2414846, "EndTime": 1616445837.2414951, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44385676875443497, "count": 1, "min": 0.44385676875443497, "max": 0.44385676875443497}}} #metrics {"StartTime": 1616445837.2415342, "EndTime": 1616445837.2415435, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4422727811203287, "count": 1, "min": 0.4422727811203287, "max": 0.4422727811203287}}} #metrics {"StartTime": 1616445837.2415798, "EndTime": 1616445837.2415888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44382950053774173, "count": 1, "min": 0.44382950053774173, "max": 0.44382950053774173}}} #metrics {"StartTime": 1616445837.2416239, "EndTime": 1616445837.2416327, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4422613404121555, "count": 1, "min": 0.4422613404121555, "max": 0.4422613404121555}}} #metrics {"StartTime": 1616445837.2416723, "EndTime": 1616445837.2416823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4438916693432483, "count": 1, "min": 0.4438916693432483, "max": 0.4438916693432483}}} #metrics {"StartTime": 1616445837.2417197, "EndTime": 1616445837.241729, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4431150687127877, "count": 1, "min": 0.4431150687127877, "max": 0.4431150687127877}}} #metrics {"StartTime": 1616445837.241766, "EndTime": 1616445837.2417753, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44387758588968534, "count": 1, "min": 0.44387758588968534, "max": 0.44387758588968534}}} #metrics {"StartTime": 1616445837.2418087, "EndTime": 1616445837.2418168, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44312470797974735, "count": 1, "min": 0.44312470797974735, "max": 0.44312470797974735}}} #metrics {"StartTime": 1616445837.24185, "EndTime": 1616445837.2418578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845627867796964, "count": 1, "min": 0.6845627867796964, "max": 0.6845627867796964}}} #metrics {"StartTime": 1616445837.2418897, "EndTime": 1616445837.2418988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6830454543653227, "count": 1, "min": 0.6830454543653227, "max": 0.6830454543653227}}} #metrics {"StartTime": 1616445837.24193, "EndTime": 1616445837.2419367, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845827406848896, "count": 1, "min": 0.6845827406848896, "max": 0.6845827406848896}}} #metrics {"StartTime": 1616445837.2419577, "EndTime": 1616445837.241963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6836304877610923, "count": 1, "min": 0.6836304877610923, "max": 0.6836304877610923}}} #metrics {"StartTime": 1616445837.2419848, "EndTime": 1616445837.24199, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838500459544812, "count": 1, "min": 0.6838500459544812, "max": 0.6838500459544812}}} #metrics {"StartTime": 1616445837.2420118, "EndTime": 1616445837.242017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.686142438773845, "count": 1, "min": 0.686142438773845, "max": 0.686142438773845}}} #metrics {"StartTime": 1616445837.2420385, "EndTime": 1616445837.242044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838347089360406, "count": 1, "min": 0.6838347089360406, "max": 0.6838347089360406}}} #metrics {"StartTime": 1616445837.242074, "EndTime": 1616445837.242082, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6861424006065706, "count": 1, "min": 0.6861424006065706, "max": 0.6861424006065706}}} [03/22/2021 20:43:57 INFO 139901614024512] #quality_metric: host=algo-1, epoch=7, validation binary_classification_cross_entropy_objective <loss>=0.15634831713936484 [03/22/2021 20:43:57 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=7, criteria=sampled_accuracy, value=0.9507362072024127 [03/22/2021 20:43:57 INFO 139901614024512] Epoch 7: Loss improved. Updating best model [03/22/2021 20:43:57 INFO 139901614024512] Saving model for epoch: 7 [03/22/2021 20:43:57 INFO 139901614024512] Saved checkpoint to "/tmp/tmpdc18jdud/mx-mod-0000.params" [03/22/2021 20:43:57 INFO 139901614024512] #progress_metric: host=algo-1, completed 53.333333333333336 % of epochs #metrics {"StartTime": 1616445825.7620873, "EndTime": 1616445837.2474544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 7, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 3619688.0, "count": 1, "min": 3619688, "max": 3619688}, "Total Batches Seen": {"sum": 3620.0, "count": 1, "min": 3620, "max": 3620}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 10.0, "count": 1, "min": 10, "max": 10}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:43:57 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=39263.58977676891 records/second [2021-03-22 20:44:07.532] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 19, "duration": 10282, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445847.5328465, "EndTime": 1616445847.5328999, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15376641269259983, "count": 1, "min": 0.15376641269259983, "max": 0.15376641269259983}}} #metrics {"StartTime": 1616445847.532957, "EndTime": 1616445847.5329664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14114376249525282, "count": 1, "min": 0.14114376249525282, "max": 0.14114376249525282}}} #metrics {"StartTime": 1616445847.532993, "EndTime": 1616445847.5330007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15369962702433268, "count": 1, "min": 0.15369962702433268, "max": 0.15369962702433268}}} #metrics {"StartTime": 1616445847.533034, "EndTime": 1616445847.533042, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1408609210035536, "count": 1, "min": 0.1408609210035536, "max": 0.1408609210035536}}} #metrics {"StartTime": 1616445847.5330732, "EndTime": 1616445847.5330813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13715782185872397, "count": 1, "min": 0.13715782185872397, "max": 0.13715782185872397}}} #metrics {"StartTime": 1616445847.5331132, "EndTime": 1616445847.533122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14010731811523439, "count": 1, "min": 0.14010731811523439, "max": 0.14010731811523439}}} #metrics {"StartTime": 1616445847.5331573, "EndTime": 1616445847.5331671, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1371600013393826, "count": 1, "min": 0.1371600013393826, "max": 0.1371600013393826}}} #metrics {"StartTime": 1616445847.5332017, "EndTime": 1616445847.5332105, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1401008796013726, "count": 1, "min": 0.1401008796013726, "max": 0.1401008796013726}}} #metrics {"StartTime": 1616445847.5332453, "EndTime": 1616445847.533255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17302495490180123, "count": 1, "min": 0.17302495490180123, "max": 0.17302495490180123}}} #metrics {"StartTime": 1616445847.533298, "EndTime": 1616445847.5333073, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17185348537868925, "count": 1, "min": 0.17185348537868925, "max": 0.17185348537868925}}} #metrics {"StartTime": 1616445847.5333438, "EndTime": 1616445847.5333536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1732452052137587, "count": 1, "min": 0.1732452052137587, "max": 0.1732452052137587}}} #metrics {"StartTime": 1616445847.5333855, "EndTime": 1616445847.5333955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17185405836317275, "count": 1, "min": 0.17185405836317275, "max": 0.17185405836317275}}} #metrics {"StartTime": 1616445847.5334303, "EndTime": 1616445847.5334396, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717990104844835, "count": 1, "min": 0.1717990104844835, "max": 0.1717990104844835}}} #metrics {"StartTime": 1616445847.533474, "EndTime": 1616445847.5334828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17405751142713757, "count": 1, "min": 0.17405751142713757, "max": 0.17405751142713757}}} #metrics {"StartTime": 1616445847.533519, "EndTime": 1616445847.5335295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17179925048828126, "count": 1, "min": 0.17179925048828126, "max": 0.17179925048828126}}} #metrics {"StartTime": 1616445847.533565, "EndTime": 1616445847.533575, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17405751953125, "count": 1, "min": 0.17405751953125, "max": 0.17405751953125}}} #metrics {"StartTime": 1616445847.5336123, "EndTime": 1616445847.5336225, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393455715603297, "count": 1, "min": 0.44393455715603297, "max": 0.44393455715603297}}} #metrics {"StartTime": 1616445847.5336604, "EndTime": 1616445847.5336702, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440041455078125, "count": 1, "min": 0.4440041455078125, "max": 0.4440041455078125}}} #metrics {"StartTime": 1616445847.5337064, "EndTime": 1616445847.5337162, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439329837375217, "count": 1, "min": 0.4439329837375217, "max": 0.4439329837375217}}} #metrics {"StartTime": 1616445847.533744, "EndTime": 1616445847.5337536, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440044474283854, "count": 1, "min": 0.4440044474283854, "max": 0.4440044474283854}}} #metrics {"StartTime": 1616445847.533788, "EndTime": 1616445847.533798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399044576009117, "count": 1, "min": 0.44399044576009117, "max": 0.44399044576009117}}} #metrics {"StartTime": 1616445847.533833, "EndTime": 1616445847.533843, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44510706095377606, "count": 1, "min": 0.44510706095377606, "max": 0.44510706095377606}}} #metrics {"StartTime": 1616445847.5338805, "EndTime": 1616445847.5338902, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.443990337117513, "count": 1, "min": 0.443990337117513, "max": 0.443990337117513}}} #metrics {"StartTime": 1616445847.5339262, "EndTime": 1616445847.5339358, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4451072546386719, "count": 1, "min": 0.4451072546386719, "max": 0.4451072546386719}}} #metrics {"StartTime": 1616445847.533968, "EndTime": 1616445847.5339775, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844479256184895, "count": 1, "min": 0.6844479256184895, "max": 0.6844479256184895}}} #metrics {"StartTime": 1616445847.534013, "EndTime": 1616445847.5340226, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684544696858724, "count": 1, "min": 0.684544696858724, "max": 0.684544696858724}}} #metrics {"StartTime": 1616445847.5340571, "EndTime": 1616445847.534067, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844480547417535, "count": 1, "min": 0.6844480547417535, "max": 0.6844480547417535}}} #metrics {"StartTime": 1616445847.5341024, "EndTime": 1616445847.5341122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845443029785157, "count": 1, "min": 0.6845443029785157, "max": 0.6845443029785157}}} #metrics {"StartTime": 1616445847.5341477, "EndTime": 1616445847.534157, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845270456271701, "count": 1, "min": 0.6845270456271701, "max": 0.6845270456271701}}} #metrics {"StartTime": 1616445847.5341935, "EndTime": 1616445847.5342028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860076589626736, "count": 1, "min": 0.6860076589626736, "max": 0.6860076589626736}}} #metrics {"StartTime": 1616445847.5342388, "EndTime": 1616445847.5342474, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845264195421007, "count": 1, "min": 0.6845264195421007, "max": 0.6845264195421007}}} #metrics {"StartTime": 1616445847.5342824, "EndTime": 1616445847.534292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6860076264105903, "count": 1, "min": 0.6860076264105903, "max": 0.6860076264105903}}} [03/22/2021 20:44:07 INFO 139901614024512] #quality_metric: host=algo-1, epoch=8, train binary_classification_cross_entropy_objective <loss>=0.15376641269259983 [2021-03-22 20:44:08.474] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 26, "duration": 927, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445849.155617, "EndTime": 1616445849.1556718, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1558937256823031, "count": 1, "min": 0.1558937256823031, "max": 0.1558937256823031}}} #metrics {"StartTime": 1616445849.1557431, "EndTime": 1616445849.1557534, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14351674949993834, "count": 1, "min": 0.14351674949993834, "max": 0.14351674949993834}}} #metrics {"StartTime": 1616445849.1557856, "EndTime": 1616445849.1557937, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15583705404706938, "count": 1, "min": 0.15583705404706938, "max": 0.15583705404706938}}} #metrics {"StartTime": 1616445849.1558237, "EndTime": 1616445849.1558313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14325664372060956, "count": 1, "min": 0.14325664372060956, "max": 0.14325664372060956}}} #metrics {"StartTime": 1616445849.1558692, "EndTime": 1616445849.1558778, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1398713914980507, "count": 1, "min": 0.1398713914980507, "max": 0.1398713914980507}}} #metrics {"StartTime": 1616445849.155911, "EndTime": 1616445849.155918, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14178702283544237, "count": 1, "min": 0.14178702283544237, "max": 0.14178702283544237}}} #metrics {"StartTime": 1616445849.1559477, "EndTime": 1616445849.1559544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1398743196859287, "count": 1, "min": 0.1398743196859287, "max": 0.1398743196859287}}} #metrics {"StartTime": 1616445849.1559844, "EndTime": 1616445849.1559916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14178284020294465, "count": 1, "min": 0.14178284020294465, "max": 0.14178284020294465}}} #metrics {"StartTime": 1616445849.1560247, "EndTime": 1616445849.1560335, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1747483507081594, "count": 1, "min": 0.1747483507081594, "max": 0.1747483507081594}}} #metrics {"StartTime": 1616445849.1560633, "EndTime": 1616445849.1560721, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17387398934140152, "count": 1, "min": 0.17387398934140152, "max": 0.17387398934140152}}} #metrics {"StartTime": 1616445849.1561098, "EndTime": 1616445849.156119, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17496310226118308, "count": 1, "min": 0.17496310226118308, "max": 0.17496310226118308}}} #metrics {"StartTime": 1616445849.156151, "EndTime": 1616445849.1561604, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17387720940065274, "count": 1, "min": 0.17387720940065274, "max": 0.17387720940065274}}} #metrics {"StartTime": 1616445849.156194, "EndTime": 1616445849.156204, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1737241822480098, "count": 1, "min": 0.1737241822480098, "max": 0.1737241822480098}}} #metrics {"StartTime": 1616445849.1562376, "EndTime": 1616445849.1562443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17393260757530202, "count": 1, "min": 0.17393260757530202, "max": 0.17393260757530202}}} #metrics {"StartTime": 1616445849.1562648, "EndTime": 1616445849.1562703, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17372360655828764, "count": 1, "min": 0.17372360655828764, "max": 0.17372360655828764}}} #metrics {"StartTime": 1616445849.1562915, "EndTime": 1616445849.1562996, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17393207343647787, "count": 1, "min": 0.17393207343647787, "max": 0.17393207343647787}}} #metrics {"StartTime": 1616445849.156335, "EndTime": 1616445849.1563444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437978761086592, "count": 1, "min": 0.4437978761086592, "max": 0.4437978761086592}}} #metrics {"StartTime": 1616445849.156391, "EndTime": 1616445849.156401, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4423678333335932, "count": 1, "min": 0.4423678333335932, "max": 0.4423678333335932}}} #metrics {"StartTime": 1616445849.1564393, "EndTime": 1616445849.1564493, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44380448310747833, "count": 1, "min": 0.44380448310747833, "max": 0.44380448310747833}}} #metrics {"StartTime": 1616445849.1564884, "EndTime": 1616445849.1564982, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44236536437111246, "count": 1, "min": 0.44236536437111246, "max": 0.44236536437111246}}} #metrics {"StartTime": 1616445849.156537, "EndTime": 1616445849.1565466, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4443337849739999, "count": 1, "min": 0.4443337849739999, "max": 0.4443337849739999}}} #metrics {"StartTime": 1616445849.1565847, "EndTime": 1616445849.1565952, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44250390508061965, "count": 1, "min": 0.44250390508061965, "max": 0.44250390508061965}}} #metrics {"StartTime": 1616445849.156634, "EndTime": 1616445849.1566439, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4443277361377326, "count": 1, "min": 0.4443277361377326, "max": 0.4443277361377326}}} #metrics {"StartTime": 1616445849.1566691, "EndTime": 1616445849.156678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44250993334445543, "count": 1, "min": 0.44250993334445543, "max": 0.44250993334445543}}} #metrics {"StartTime": 1616445849.1567075, "EndTime": 1616445849.1567152, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845475723837757, "count": 1, "min": 0.6845475723837757, "max": 0.6845475723837757}}} #metrics {"StartTime": 1616445849.1567364, "EndTime": 1616445849.1567414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6829276755703284, "count": 1, "min": 0.6829276755703284, "max": 0.6829276755703284}}} #metrics {"StartTime": 1616445849.1567717, "EndTime": 1616445849.15678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845786256571917, "count": 1, "min": 0.6845786256571917, "max": 0.6845786256571917}}} #metrics {"StartTime": 1616445849.1568093, "EndTime": 1616445849.1568155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6835635973118458, "count": 1, "min": 0.6835635973118458, "max": 0.6835635973118458}}} #metrics {"StartTime": 1616445849.156847, "EndTime": 1616445849.156856, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6838613434677029, "count": 1, "min": 0.6838613434677029, "max": 0.6838613434677029}}} #metrics {"StartTime": 1616445849.1568875, "EndTime": 1616445849.1568973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682518684802716, "count": 1, "min": 0.682518684802716, "max": 0.682518684802716}}} #metrics {"StartTime": 1616445849.156931, "EndTime": 1616445849.1569397, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6839086170206684, "count": 1, "min": 0.6839086170206684, "max": 0.6839086170206684}}} #metrics {"StartTime": 1616445849.156974, "EndTime": 1616445849.1569824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6825186233561111, "count": 1, "min": 0.6825186233561111, "max": 0.6825186233561111}}} [03/22/2021 20:44:09 INFO 139901614024512] #quality_metric: host=algo-1, epoch=8, validation binary_classification_cross_entropy_objective <loss>=0.1558937256823031 [03/22/2021 20:44:09 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=8, criteria=sampled_accuracy, value=0.9506297676068832 [03/22/2021 20:44:09 INFO 139901614024512] Epoch 8: Loss improved. Updating best model [03/22/2021 20:44:09 INFO 139901614024512] Saving model for epoch: 8 [03/22/2021 20:44:09 INFO 139901614024512] Saved checkpoint to "/tmp/tmpts2pn807/mx-mod-0000.params" [03/22/2021 20:44:09 INFO 139901614024512] #progress_metric: host=algo-1, completed 60.0 % of epochs #metrics {"StartTime": 1616445837.2498214, "EndTime": 1616445849.1622818, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 8, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4070649.0, "count": 1, "min": 4070649, "max": 4070649}, "Total Batches Seen": {"sum": 4071.0, "count": 1, "min": 4071, "max": 4071}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 11.0, "count": 1, "min": 11, "max": 11}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:44:09 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=37855.90265300081 records/second [2021-03-22 20:44:18.410] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 21, "duration": 9247, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445858.410686, "EndTime": 1616445858.4107594, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15336843039618597, "count": 1, "min": 0.15336843039618597, "max": 0.15336843039618597}}} #metrics {"StartTime": 1616445858.4108927, "EndTime": 1616445858.4109092, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.14035081766764324, "count": 1, "min": 0.14035081766764324, "max": 0.14035081766764324}}} #metrics {"StartTime": 1616445858.4109519, "EndTime": 1616445858.4109616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1532345390150282, "count": 1, "min": 0.1532345390150282, "max": 0.1532345390150282}}} #metrics {"StartTime": 1616445858.4109979, "EndTime": 1616445858.411007, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1401142953491211, "count": 1, "min": 0.1401142953491211, "max": 0.1401142953491211}}} #metrics {"StartTime": 1616445858.4110305, "EndTime": 1616445858.4110363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1371176651848687, "count": 1, "min": 0.1371176651848687, "max": 0.1371176651848687}}} #metrics {"StartTime": 1616445858.411056, "EndTime": 1616445858.4110615, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13996831832885742, "count": 1, "min": 0.13996831832885742, "max": 0.13996831832885742}}} #metrics {"StartTime": 1616445858.411085, "EndTime": 1616445858.411093, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1371197081841363, "count": 1, "min": 0.1371197081841363, "max": 0.1371197081841363}}} #metrics {"StartTime": 1616445858.411132, "EndTime": 1616445858.411142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13996472217135958, "count": 1, "min": 0.13996472217135958, "max": 0.13996472217135958}}} #metrics {"StartTime": 1616445858.4111795, "EndTime": 1616445858.4111888, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17288381174723308, "count": 1, "min": 0.17288381174723308, "max": 0.17288381174723308}}} #metrics {"StartTime": 1616445858.4112287, "EndTime": 1616445858.411239, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718507889811198, "count": 1, "min": 0.1718507889811198, "max": 0.1718507889811198}}} #metrics {"StartTime": 1616445858.4112775, "EndTime": 1616445858.4112875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17306361979166668, "count": 1, "min": 0.17306361979166668, "max": 0.17306361979166668}}} #metrics {"StartTime": 1616445858.4113257, "EndTime": 1616445858.4113357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718512087334527, "count": 1, "min": 0.1718512087334527, "max": 0.1718512087334527}}} #metrics {"StartTime": 1616445858.4113739, "EndTime": 1616445858.4113836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17176425906711154, "count": 1, "min": 0.17176425906711154, "max": 0.17176425906711154}}} #metrics {"StartTime": 1616445858.411422, "EndTime": 1616445858.4114313, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17395088419596355, "count": 1, "min": 0.17395088419596355, "max": 0.17395088419596355}}} #metrics {"StartTime": 1616445858.411466, "EndTime": 1616445858.4114752, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717643709309896, "count": 1, "min": 0.1717643709309896, "max": 0.1717643709309896}}} #metrics {"StartTime": 1616445858.4115086, "EndTime": 1616445858.4115171, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1739508883327908, "count": 1, "min": 0.1739508883327908, "max": 0.1739508883327908}}} #metrics {"StartTime": 1616445858.4115484, "EndTime": 1616445858.411557, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44392982326931424, "count": 1, "min": 0.44392982326931424, "max": 0.44392982326931424}}} #metrics {"StartTime": 1616445858.411589, "EndTime": 1616445858.4115973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440023221842448, "count": 1, "min": 0.4440023221842448, "max": 0.4440023221842448}}} #metrics {"StartTime": 1616445858.41163, "EndTime": 1616445858.411638, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439271041531033, "count": 1, "min": 0.4439271041531033, "max": 0.4439271041531033}}} #metrics {"StartTime": 1616445858.4116702, "EndTime": 1616445858.4116788, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440024850124783, "count": 1, "min": 0.4440024850124783, "max": 0.4440024850124783}}} #metrics {"StartTime": 1616445858.4117134, "EndTime": 1616445858.4117227, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439657440185547, "count": 1, "min": 0.4439657440185547, "max": 0.4439657440185547}}} #metrics {"StartTime": 1616445858.4117572, "EndTime": 1616445858.4117672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.445063873562283, "count": 1, "min": 0.445063873562283, "max": 0.445063873562283}}} #metrics {"StartTime": 1616445858.4118004, "EndTime": 1616445858.411809, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439658280436198, "count": 1, "min": 0.4439658280436198, "max": 0.4439658280436198}}} #metrics {"StartTime": 1616445858.4118426, "EndTime": 1616445858.4118521, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4450639609781901, "count": 1, "min": 0.4450639609781901, "max": 0.4450639609781901}}} #metrics {"StartTime": 1616445858.4118872, "EndTime": 1616445858.4118972, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684445331624349, "count": 1, "min": 0.684445331624349, "max": 0.684445331624349}}} #metrics {"StartTime": 1616445858.4119322, "EndTime": 1616445858.411942, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684541993001302, "count": 1, "min": 0.684541993001302, "max": 0.684541993001302}}} #metrics {"StartTime": 1616445858.4119763, "EndTime": 1616445858.4119864, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477361382378, "count": 1, "min": 0.6844477361382378, "max": 0.6844477361382378}}} #metrics {"StartTime": 1616445858.4120212, "EndTime": 1616445858.4120307, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845422124565972, "count": 1, "min": 0.6845422124565972, "max": 0.6845422124565972}}} #metrics {"StartTime": 1616445858.4120657, "EndTime": 1616445858.4120762, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845084868706597, "count": 1, "min": 0.6845084868706597, "max": 0.6845084868706597}}} #metrics {"StartTime": 1616445858.4121122, "EndTime": 1616445858.4121213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6859120659722222, "count": 1, "min": 0.6859120659722222, "max": 0.6859120659722222}}} #metrics {"StartTime": 1616445858.4121568, "EndTime": 1616445858.4121666, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684508350423177, "count": 1, "min": 0.684508350423177, "max": 0.684508350423177}}} #metrics {"StartTime": 1616445858.4122074, "EndTime": 1616445858.4122174, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.68591205335829, "count": 1, "min": 0.68591205335829, "max": 0.68591205335829}}} [03/22/2021 20:44:18 INFO 139901614024512] #quality_metric: host=algo-1, epoch=9, train binary_classification_cross_entropy_objective <loss>=0.15336843039618597 [2021-03-22 20:44:19.456] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 29, "duration": 1030, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445860.079509, "EndTime": 1616445860.0795677, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15558660154290205, "count": 1, "min": 0.15558660154290205, "max": 0.15558660154290205}}} #metrics {"StartTime": 1616445860.0796373, "EndTime": 1616445860.0796497, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14280452772258592, "count": 1, "min": 0.14280452772258592, "max": 0.14280452772258592}}} #metrics {"StartTime": 1616445860.0796862, "EndTime": 1616445860.079695, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15539458618109925, "count": 1, "min": 0.15539458618109925, "max": 0.15539458618109925}}} #metrics {"StartTime": 1616445860.0797284, "EndTime": 1616445860.079735, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.142584701884569, "count": 1, "min": 0.142584701884569, "max": 0.142584701884569}}} #metrics {"StartTime": 1616445860.0797718, "EndTime": 1616445860.0797803, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13988127296478883, "count": 1, "min": 0.13988127296478883, "max": 0.13988127296478883}}} #metrics {"StartTime": 1616445860.0798175, "EndTime": 1616445860.0798264, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1416505466777212, "count": 1, "min": 0.1416505466777212, "max": 0.1416505466777212}}} #metrics {"StartTime": 1616445860.0798585, "EndTime": 1616445860.0798678, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13988378841825808, "count": 1, "min": 0.13988378841825808, "max": 0.13988378841825808}}} #metrics {"StartTime": 1616445860.0799024, "EndTime": 1616445860.079912, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14164864237434965, "count": 1, "min": 0.14164864237434965, "max": 0.14164864237434965}}} #metrics {"StartTime": 1616445860.079951, "EndTime": 1616445860.079963, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17464051584159523, "count": 1, "min": 0.17464051584159523, "max": 0.17464051584159523}}} #metrics {"StartTime": 1616445860.0799956, "EndTime": 1616445860.0800045, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1738913985586175, "count": 1, "min": 0.1738913985586175, "max": 0.1738913985586175}}} #metrics {"StartTime": 1616445860.080034, "EndTime": 1616445860.0800426, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17478750072220062, "count": 1, "min": 0.17478750072220062, "max": 0.17478750072220062}}} #metrics {"StartTime": 1616445860.0800765, "EndTime": 1616445860.0800858, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17389401978416097, "count": 1, "min": 0.17389401978416097, "max": 0.17389401978416097}}} #metrics {"StartTime": 1616445860.0801237, "EndTime": 1616445860.0801306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17361473156582363, "count": 1, "min": 0.17361473156582363, "max": 0.17361473156582363}}} #metrics {"StartTime": 1616445860.0801625, "EndTime": 1616445860.08017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17386891668054763, "count": 1, "min": 0.17386891668054763, "max": 0.17386891668054763}}} #metrics {"StartTime": 1616445860.0802026, "EndTime": 1616445860.0802116, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17361424574514472, "count": 1, "min": 0.17361424574514472, "max": 0.17361424574514472}}} #metrics {"StartTime": 1616445860.0802405, "EndTime": 1616445860.0802462, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1738685043521737, "count": 1, "min": 0.1738685043521737, "max": 0.1738685043521737}}} #metrics {"StartTime": 1616445860.0802777, "EndTime": 1616445860.080287, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437851572028284, "count": 1, "min": 0.4437851572028284, "max": 0.4437851572028284}}} #metrics {"StartTime": 1616445860.080322, "EndTime": 1616445860.0803318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44247641787580594, "count": 1, "min": 0.44247641787580594, "max": 0.44247641787580594}}} #metrics {"StartTime": 1616445860.0803676, "EndTime": 1616445860.080377, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44381036492808396, "count": 1, "min": 0.44381036492808396, "max": 0.44381036492808396}}} #metrics {"StartTime": 1616445860.080412, "EndTime": 1616445860.0804217, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44247665093980065, "count": 1, "min": 0.44247665093980065, "max": 0.44247665093980065}}} #metrics {"StartTime": 1616445860.0804582, "EndTime": 1616445860.0804672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44547701502852943, "count": 1, "min": 0.44547701502852943, "max": 0.44547701502852943}}} #metrics {"StartTime": 1616445860.080505, "EndTime": 1616445860.0805151, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4422047908580618, "count": 1, "min": 0.4422047908580618, "max": 0.4422047908580618}}} #metrics {"StartTime": 1616445860.0805507, "EndTime": 1616445860.0805602, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44547450816946416, "count": 1, "min": 0.44547450816946416, "max": 0.44547450816946416}}} #metrics {"StartTime": 1616445860.0805986, "EndTime": 1616445860.0806086, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44220794304182326, "count": 1, "min": 0.44220794304182326, "max": 0.44220794304182326}}} #metrics {"StartTime": 1616445860.0806427, "EndTime": 1616445860.0806513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684555874442682, "count": 1, "min": 0.684555874442682, "max": 0.684555874442682}}} #metrics {"StartTime": 1616445860.080674, "EndTime": 1616445860.08068, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6828610650144276, "count": 1, "min": 0.6828610650144276, "max": 0.6828610650144276}}} #metrics {"StartTime": 1616445860.08071, "EndTime": 1616445860.0807197, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845852751543235, "count": 1, "min": 0.6845852751543235, "max": 0.6845852751543235}}} #metrics {"StartTime": 1616445860.0807571, "EndTime": 1616445860.0807672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6833626198138416, "count": 1, "min": 0.6833626198138416, "max": 0.6833626198138416}}} #metrics {"StartTime": 1616445860.080804, "EndTime": 1616445860.080814, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842219348831001, "count": 1, "min": 0.6842219348831001, "max": 0.6842219348831001}}} #metrics {"StartTime": 1616445860.0808504, "EndTime": 1616445860.0808601, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6816219966631949, "count": 1, "min": 0.6816219966631949, "max": 0.6816219966631949}}} #metrics {"StartTime": 1616445860.0808942, "EndTime": 1616445860.0809028, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6841695239067247, "count": 1, "min": 0.6841695239067247, "max": 0.6841695239067247}}} #metrics {"StartTime": 1616445860.080935, "EndTime": 1616445860.0809438, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6816219912493972, "count": 1, "min": 0.6816219912493972, "max": 0.6816219912493972}}} [03/22/2021 20:44:20 INFO 139901614024512] #quality_metric: host=algo-1, epoch=9, validation binary_classification_cross_entropy_objective <loss>=0.15558660154290205 [03/22/2021 20:44:20 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=9, criteria=sampled_accuracy, value=0.950612027674295 [03/22/2021 20:44:20 INFO 139901614024512] Epoch 9: Loss improved. Updating best model [03/22/2021 20:44:20 INFO 139901614024512] Saving model for epoch: 9 [03/22/2021 20:44:20 INFO 139901614024512] Saved checkpoint to "/tmp/tmpmb9cygbw/mx-mod-0000.params" [03/22/2021 20:44:20 INFO 139901614024512] #progress_metric: host=algo-1, completed 66.66666666666667 % of epochs #metrics {"StartTime": 1616445849.1625748, "EndTime": 1616445860.0862033, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 9, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4521610.0, "count": 1, "min": 4521610, "max": 4521610}, "Total Batches Seen": {"sum": 4522.0, "count": 1, "min": 4522, "max": 4522}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 12.0, "count": 1, "min": 12, "max": 12}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:44:20 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=41282.641863452096 records/second [2021-03-22 20:44:29.736] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 23, "duration": 9647, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445869.7361255, "EndTime": 1616445869.7361875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15309933558146158, "count": 1, "min": 0.15309933558146158, "max": 0.15309933558146158}}} #metrics {"StartTime": 1616445869.736255, "EndTime": 1616445869.736265, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13972446699354385, "count": 1, "min": 0.13972446699354385, "max": 0.13972446699354385}}} #metrics {"StartTime": 1616445869.736294, "EndTime": 1616445869.736301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1527677818467882, "count": 1, "min": 0.1527677818467882, "max": 0.1527677818467882}}} #metrics {"StartTime": 1616445869.7363265, "EndTime": 1616445869.736333, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13952415861341688, "count": 1, "min": 0.13952415861341688, "max": 0.13952415861341688}}} #metrics {"StartTime": 1616445869.7363572, "EndTime": 1616445869.7363632, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1370919046359592, "count": 1, "min": 0.1370919046359592, "max": 0.1370919046359592}}} #metrics {"StartTime": 1616445869.7364035, "EndTime": 1616445869.7364113, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13984401150173612, "count": 1, "min": 0.13984401150173612, "max": 0.13984401150173612}}} #metrics {"StartTime": 1616445869.7364368, "EndTime": 1616445869.736443, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13708801673041449, "count": 1, "min": 0.13708801673041449, "max": 0.13708801673041449}}} #metrics {"StartTime": 1616445869.736467, "EndTime": 1616445869.736473, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13984205103556316, "count": 1, "min": 0.13984205103556316, "max": 0.13984205103556316}}} #metrics {"StartTime": 1616445869.7364967, "EndTime": 1616445869.7365024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17278777787950303, "count": 1, "min": 0.17278777787950303, "max": 0.17278777787950303}}} #metrics {"StartTime": 1616445869.736526, "EndTime": 1616445869.7365322, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184655225965711, "count": 1, "min": 0.17184655225965711, "max": 0.17184655225965711}}} #metrics {"StartTime": 1616445869.7365556, "EndTime": 1616445869.7365613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17288363325330947, "count": 1, "min": 0.17288363325330947, "max": 0.17288363325330947}}} #metrics {"StartTime": 1616445869.7365937, "EndTime": 1616445869.7366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184680769178604, "count": 1, "min": 0.17184680769178604, "max": 0.17184680769178604}}} #metrics {"StartTime": 1616445869.7366238, "EndTime": 1616445869.7366297, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717463905843099, "count": 1, "min": 0.1717463905843099, "max": 0.1717463905843099}}} #metrics {"StartTime": 1616445869.7366536, "EndTime": 1616445869.7366595, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1738483911810981, "count": 1, "min": 0.1738483911810981, "max": 0.1738483911810981}}} #metrics {"StartTime": 1616445869.7366827, "EndTime": 1616445869.7366886, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17174641642252605, "count": 1, "min": 0.17174641642252605, "max": 0.17174641642252605}}} #metrics {"StartTime": 1616445869.7367125, "EndTime": 1616445869.7367184, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17384838860405816, "count": 1, "min": 0.17384838860405816, "max": 0.17384838860405816}}} #metrics {"StartTime": 1616445869.7367444, "EndTime": 1616445869.7367508, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439274230278863, "count": 1, "min": 0.4439274230278863, "max": 0.4439274230278863}}} #metrics {"StartTime": 1616445869.7367744, "EndTime": 1616445869.7367804, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44400060485839843, "count": 1, "min": 0.44400060485839843, "max": 0.44400060485839843}}} #metrics {"StartTime": 1616445869.736804, "EndTime": 1616445869.73681, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44392721598307294, "count": 1, "min": 0.44392721598307294, "max": 0.44392721598307294}}} #metrics {"StartTime": 1616445869.7368364, "EndTime": 1616445869.7368424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4440007057020399, "count": 1, "min": 0.4440007057020399, "max": 0.4440007057020399}}} #metrics {"StartTime": 1616445869.7368686, "EndTime": 1616445869.7368748, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439389296468099, "count": 1, "min": 0.4439389296468099, "max": 0.4439389296468099}}} #metrics {"StartTime": 1616445869.7368987, "EndTime": 1616445869.7369044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44503036532931856, "count": 1, "min": 0.44503036532931856, "max": 0.44503036532931856}}} #metrics {"StartTime": 1616445869.7369306, "EndTime": 1616445869.7369368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439388009304471, "count": 1, "min": 0.4439388009304471, "max": 0.4439388009304471}}} #metrics {"StartTime": 1616445869.7369614, "EndTime": 1616445869.7369676, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.445030398695204, "count": 1, "min": 0.445030398695204, "max": 0.445030398695204}}} #metrics {"StartTime": 1616445869.736993, "EndTime": 1616445869.7369988, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844435021972656, "count": 1, "min": 0.6844435021972656, "max": 0.6844435021972656}}} #metrics {"StartTime": 1616445869.7370224, "EndTime": 1616445869.7370284, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845388266330296, "count": 1, "min": 0.6845388266330296, "max": 0.6845388266330296}}} #metrics {"StartTime": 1616445869.7370517, "EndTime": 1616445869.7370574, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477248806423, "count": 1, "min": 0.6844477248806423, "max": 0.6844477248806423}}} #metrics {"StartTime": 1616445869.7370808, "EndTime": 1616445869.7370868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845388575575087, "count": 1, "min": 0.6845388575575087, "max": 0.6845388575575087}}} #metrics {"StartTime": 1616445869.73711, "EndTime": 1616445869.7371159, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844864995659722, "count": 1, "min": 0.6844864995659722, "max": 0.6844864995659722}}} #metrics {"StartTime": 1616445869.7371392, "EndTime": 1616445869.737145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6858378937445746, "count": 1, "min": 0.6858378937445746, "max": 0.6858378937445746}}} #metrics {"StartTime": 1616445869.7371678, "EndTime": 1616445869.7371736, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844869512261285, "count": 1, "min": 0.6844869512261285, "max": 0.6844869512261285}}} #metrics {"StartTime": 1616445869.7371964, "EndTime": 1616445869.7372024, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6858378899468316, "count": 1, "min": 0.6858378899468316, "max": 0.6858378899468316}}} [03/22/2021 20:44:29 INFO 139901614024512] #quality_metric: host=algo-1, epoch=10, train binary_classification_cross_entropy_objective <loss>=0.15309933558146158 [2021-03-22 20:44:30.772] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 32, "duration": 1019, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445871.414503, "EndTime": 1616445871.414565, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1553802817769141, "count": 1, "min": 0.1553802817769141, "max": 0.1553802817769141}}} #metrics {"StartTime": 1616445871.4146354, "EndTime": 1616445871.4146452, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14223124849388147, "count": 1, "min": 0.14223124849388147, "max": 0.14223124849388147}}} #metrics {"StartTime": 1616445871.4146729, "EndTime": 1616445871.4146807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15493968099445576, "count": 1, "min": 0.15493968099445576, "max": 0.15493968099445576}}} #metrics {"StartTime": 1616445871.4147136, "EndTime": 1616445871.414743, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14204876581489437, "count": 1, "min": 0.14204876581489437, "max": 0.14204876581489437}}} #metrics {"StartTime": 1616445871.414781, "EndTime": 1616445871.4148111, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13989055931980524, "count": 1, "min": 0.13989055931980524, "max": 0.13989055931980524}}} #metrics {"StartTime": 1616445871.4148555, "EndTime": 1616445871.414866, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14151489720692212, "count": 1, "min": 0.14151489720692212, "max": 0.14151489720692212}}} #metrics {"StartTime": 1616445871.4149036, "EndTime": 1616445871.4149137, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.139892861943349, "count": 1, "min": 0.139892861943349, "max": 0.139892861943349}}} #metrics {"StartTime": 1616445871.4149528, "EndTime": 1616445871.4149613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1415142922150194, "count": 1, "min": 0.1415142922150194, "max": 0.1415142922150194}}} #metrics {"StartTime": 1616445871.4149928, "EndTime": 1616445871.415002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17456906602719754, "count": 1, "min": 0.17456906602719754, "max": 0.17456906602719754}}} #metrics {"StartTime": 1616445871.4150352, "EndTime": 1616445871.415044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17390330959047348, "count": 1, "min": 0.17390330959047348, "max": 0.17390330959047348}}} #metrics {"StartTime": 1616445871.4150808, "EndTime": 1616445871.4150898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17461220939383135, "count": 1, "min": 0.17461220939383135, "max": 0.17461220939383135}}} #metrics {"StartTime": 1616445871.4151266, "EndTime": 1616445871.4151347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17390525070767, "count": 1, "min": 0.17390525070767, "max": 0.17390525070767}}} #metrics {"StartTime": 1616445871.4151685, "EndTime": 1616445871.4151778, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17357975511616883, "count": 1, "min": 0.17357975511616883, "max": 0.17357975511616883}}} #metrics {"StartTime": 1616445871.4152105, "EndTime": 1616445871.415217, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17383827979585392, "count": 1, "min": 0.17383827979585392, "max": 0.17383827979585392}}} #metrics {"StartTime": 1616445871.4152493, "EndTime": 1616445871.4152586, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17357949430646044, "count": 1, "min": 0.17357949430646044, "max": 0.17357949430646044}}} #metrics {"StartTime": 1616445871.4152985, "EndTime": 1616445871.4153087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17383797750292, "count": 1, "min": 0.17383797750292, "max": 0.17383797750292}}} #metrics {"StartTime": 1616445871.4153423, "EndTime": 1616445871.4153488, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437802328123614, "count": 1, "min": 0.4437802328123614, "max": 0.4437802328123614}}} #metrics {"StartTime": 1616445871.415373, "EndTime": 1616445871.4153807, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44267105419246233, "count": 1, "min": 0.44267105419246233, "max": 0.44267105419246233}}} #metrics {"StartTime": 1616445871.4154122, "EndTime": 1616445871.4154198, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4438152950030387, "count": 1, "min": 0.4438152950030387, "max": 0.4438152950030387}}} #metrics {"StartTime": 1616445871.415452, "EndTime": 1616445871.4154606, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.442670514436823, "count": 1, "min": 0.442670514436823, "max": 0.442670514436823}}} #metrics {"StartTime": 1616445871.4154913, "EndTime": 1616445871.4155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4451743387977177, "count": 1, "min": 0.4451743387977177, "max": 0.4451743387977177}}} #metrics {"StartTime": 1616445871.4155335, "EndTime": 1616445871.4155424, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4418476677922169, "count": 1, "min": 0.4418476677922169, "max": 0.4418476677922169}}} #metrics {"StartTime": 1616445871.4155724, "EndTime": 1616445871.4155817, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44517914354325355, "count": 1, "min": 0.44517914354325355, "max": 0.44517914354325355}}} #metrics {"StartTime": 1616445871.4156165, "EndTime": 1616445871.4156256, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44184914169866435, "count": 1, "min": 0.44184914169866435, "max": 0.44184914169866435}}} #metrics {"StartTime": 1616445871.4156525, "EndTime": 1616445871.415661, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845530874195813, "count": 1, "min": 0.6845530874195813, "max": 0.6845530874195813}}} #metrics {"StartTime": 1616445871.4156954, "EndTime": 1616445871.4157038, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6829776554808076, "count": 1, "min": 0.6829776554808076, "max": 0.6829776554808076}}} #metrics {"StartTime": 1616445871.415731, "EndTime": 1616445871.415739, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845921907396166, "count": 1, "min": 0.6845921907396166, "max": 0.6845921907396166}}} #metrics {"StartTime": 1616445871.4157727, "EndTime": 1616445871.415782, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6833226743775606, "count": 1, "min": 0.6833226743775606, "max": 0.6833226743775606}}} #metrics {"StartTime": 1616445871.4158149, "EndTime": 1616445871.415824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6840448076005563, "count": 1, "min": 0.6840448076005563, "max": 0.6840448076005563}}} #metrics {"StartTime": 1616445871.415856, "EndTime": 1616445871.4158645, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821315416867627, "count": 1, "min": 0.6821315416867627, "max": 0.6821315416867627}}} #metrics {"StartTime": 1616445871.4158976, "EndTime": 1616445871.4159062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684038151877557, "count": 1, "min": 0.684038151877557, "max": 0.684038151877557}}} #metrics {"StartTime": 1616445871.4159434, "EndTime": 1616445871.4159527, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6821315568453965, "count": 1, "min": 0.6821315568453965, "max": 0.6821315568453965}}} [03/22/2021 20:44:31 INFO 139901614024512] #quality_metric: host=algo-1, epoch=10, validation binary_classification_cross_entropy_objective <loss>=0.1553802817769141 [03/22/2021 20:44:31 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=10, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:44:31 INFO 139901614024512] Epoch 10: Loss improved. Updating best model [03/22/2021 20:44:31 INFO 139901614024512] Saving model for epoch: 10 [03/22/2021 20:44:31 INFO 139901614024512] Saved checkpoint to "/tmp/tmpjfqjqc4w/mx-mod-0000.params" [03/22/2021 20:44:31 INFO 139901614024512] #progress_metric: host=algo-1, completed 73.33333333333333 % of epochs #metrics {"StartTime": 1616445860.088792, "EndTime": 1616445871.4211576, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 10, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 4972571.0, "count": 1, "min": 4972571, "max": 4972571}, "Total Batches Seen": {"sum": 4973.0, "count": 1, "min": 4973, "max": 4973}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 13.0, "count": 1, "min": 13, "max": 13}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:44:31 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=39793.699652826355 records/second [2021-03-22 20:44:40.954] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 25, "duration": 9532, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445880.954527, "EndTime": 1616445880.954578, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15291873424953883, "count": 1, "min": 0.15291873424953883, "max": 0.15291873424953883}}} #metrics {"StartTime": 1616445880.954644, "EndTime": 1616445880.9546537, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13922340242173936, "count": 1, "min": 0.13922340242173936, "max": 0.13922340242173936}}} #metrics {"StartTime": 1616445880.9546785, "EndTime": 1616445880.954687, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15228688841078017, "count": 1, "min": 0.15228688841078017, "max": 0.15228688841078017}}} #metrics {"StartTime": 1616445880.954717, "EndTime": 1616445880.9547246, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1390569423421224, "count": 1, "min": 0.1390569423421224, "max": 0.1390569423421224}}} #metrics {"StartTime": 1616445880.954759, "EndTime": 1616445880.9547668, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.137066295115153, "count": 1, "min": 0.137066295115153, "max": 0.137066295115153}}} #metrics {"StartTime": 1616445880.9548132, "EndTime": 1616445880.9548242, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13972987475925022, "count": 1, "min": 0.13972987475925022, "max": 0.13972987475925022}}} #metrics {"StartTime": 1616445880.9548619, "EndTime": 1616445880.9548717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1370681253560384, "count": 1, "min": 0.1370681253560384, "max": 0.1370681253560384}}} #metrics {"StartTime": 1616445880.954909, "EndTime": 1616445880.9549189, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13972875142415364, "count": 1, "min": 0.13972875142415364, "max": 0.13972875142415364}}} #metrics {"StartTime": 1616445880.9549618, "EndTime": 1616445880.9549716, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1727221388414171, "count": 1, "min": 0.1727221388414171, "max": 0.1727221388414171}}} #metrics {"StartTime": 1616445880.955006, "EndTime": 1616445880.9550157, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184292260064019, "count": 1, "min": 0.17184292260064019, "max": 0.17184292260064019}}} #metrics {"StartTime": 1616445880.9550526, "EndTime": 1616445880.955062, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17270771402994792, "count": 1, "min": 0.17270771402994792, "max": 0.17270771402994792}}} #metrics {"StartTime": 1616445880.955101, "EndTime": 1616445880.95511, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17184302642822266, "count": 1, "min": 0.17184302642822266, "max": 0.17184302642822266}}} #metrics {"StartTime": 1616445880.9551458, "EndTime": 1616445880.9551551, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17173597768147786, "count": 1, "min": 0.17173597768147786, "max": 0.17173597768147786}}} #metrics {"StartTime": 1616445880.9551897, "EndTime": 1616445880.9551992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737611404079861, "count": 1, "min": 0.1737611404079861, "max": 0.1737611404079861}}} #metrics {"StartTime": 1616445880.9552326, "EndTime": 1616445880.9552414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17173595136854383, "count": 1, "min": 0.17173595136854383, "max": 0.17173595136854383}}} #metrics {"StartTime": 1616445880.9552724, "EndTime": 1616445880.9552813, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1737611366780599, "count": 1, "min": 0.1737611366780599, "max": 0.1737611366780599}}} #metrics {"StartTime": 1616445880.955314, "EndTime": 1616445880.9553223, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439265356445313, "count": 1, "min": 0.4439265356445313, "max": 0.4439265356445313}}} #metrics {"StartTime": 1616445880.9553547, "EndTime": 1616445880.9553628, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399905815972224, "count": 1, "min": 0.44399905815972224, "max": 0.44399905815972224}}} #metrics {"StartTime": 1616445880.9553936, "EndTime": 1616445880.9554017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44392735900878905, "count": 1, "min": 0.44392735900878905, "max": 0.44392735900878905}}} #metrics {"StartTime": 1616445880.9554327, "EndTime": 1616445880.9554422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439991190592448, "count": 1, "min": 0.4439991190592448, "max": 0.4439991190592448}}} #metrics {"StartTime": 1616445880.955477, "EndTime": 1616445880.9554868, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439420762125651, "count": 1, "min": 0.4439420762125651, "max": 0.4439420762125651}}} #metrics {"StartTime": 1616445880.9555252, "EndTime": 1616445880.955535, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4450033934190538, "count": 1, "min": 0.4450033934190538, "max": 0.4450033934190538}}} #metrics {"StartTime": 1616445880.9555697, "EndTime": 1616445880.9555798, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44394203762478296, "count": 1, "min": 0.44394203762478296, "max": 0.44394203762478296}}} #metrics {"StartTime": 1616445880.9556162, "EndTime": 1616445880.955626, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.445003408203125, "count": 1, "min": 0.445003408203125, "max": 0.445003408203125}}} #metrics {"StartTime": 1616445880.9556608, "EndTime": 1616445880.955669, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844426246473524, "count": 1, "min": 0.6844426246473524, "max": 0.6844426246473524}}} #metrics {"StartTime": 1616445880.955692, "EndTime": 1616445880.9556973, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845369839138454, "count": 1, "min": 0.6845369839138454, "max": 0.6845369839138454}}} #metrics {"StartTime": 1616445880.9557168, "EndTime": 1616445880.955722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477256944445, "count": 1, "min": 0.6844477256944445, "max": 0.6844477256944445}}} #metrics {"StartTime": 1616445880.9557412, "EndTime": 1616445880.9557464, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845370450846354, "count": 1, "min": 0.6845370450846354, "max": 0.6845370450846354}}} #metrics {"StartTime": 1616445880.955765, "EndTime": 1616445880.95577, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844719333224827, "count": 1, "min": 0.6844719333224827, "max": 0.6844719333224827}}} #metrics {"StartTime": 1616445880.955789, "EndTime": 1616445880.955794, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6857498444281684, "count": 1, "min": 0.6857498444281684, "max": 0.6857498444281684}}} #metrics {"StartTime": 1616445880.9558215, "EndTime": 1616445880.9558272, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844718901909722, "count": 1, "min": 0.6844718901909722, "max": 0.6844718901909722}}} #metrics {"StartTime": 1616445880.9558465, "EndTime": 1616445880.9558518, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6857498411729601, "count": 1, "min": 0.6857498411729601, "max": 0.6857498411729601}}} [03/22/2021 20:44:40 INFO 139901614024512] #quality_metric: host=algo-1, epoch=11, train binary_classification_cross_entropy_objective <loss>=0.15291873424953883 [2021-03-22 20:44:42.036] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 35, "duration": 1067, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445882.6770253, "EndTime": 1616445882.6770873, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15524973887087753, "count": 1, "min": 0.15524973887087753, "max": 0.15524973887087753}}} #metrics {"StartTime": 1616445882.6771555, "EndTime": 1616445882.6771688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14177517588941768, "count": 1, "min": 0.14177517588941768, "max": 0.14177517588941768}}} #metrics {"StartTime": 1616445882.6772065, "EndTime": 1616445882.6772156, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15448213746113326, "count": 1, "min": 0.15448213746113326, "max": 0.15448213746113326}}} #metrics {"StartTime": 1616445882.6772501, "EndTime": 1616445882.6772597, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14162405567937272, "count": 1, "min": 0.14162405567937272, "max": 0.14162405567937272}}} #metrics {"StartTime": 1616445882.6772923, "EndTime": 1616445882.6773005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13990926087822542, "count": 1, "min": 0.13990926087822542, "max": 0.13990926087822542}}} #metrics {"StartTime": 1616445882.6773312, "EndTime": 1616445882.6773398, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14145197053739783, "count": 1, "min": 0.14145197053739783, "max": 0.14145197053739783}}} #metrics {"StartTime": 1616445882.67737, "EndTime": 1616445882.6773791, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13991142402880366, "count": 1, "min": 0.13991142402880366, "max": 0.13991142402880366}}} #metrics {"StartTime": 1616445882.6774132, "EndTime": 1616445882.677422, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14145181780062777, "count": 1, "min": 0.14145181780062777, "max": 0.14145181780062777}}} #metrics {"StartTime": 1616445882.6774583, "EndTime": 1616445882.6774697, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17452008387965048, "count": 1, "min": 0.17452008387965048, "max": 0.17452008387965048}}} #metrics {"StartTime": 1616445882.6775038, "EndTime": 1616445882.677513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1739124124177449, "count": 1, "min": 0.1739124124177449, "max": 0.1739124124177449}}} #metrics {"StartTime": 1616445882.6775477, "EndTime": 1616445882.6775572, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17444220024029033, "count": 1, "min": 0.17444220024029033, "max": 0.17444220024029033}}} #metrics {"StartTime": 1616445882.6775901, "EndTime": 1616445882.677599, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1739136595537376, "count": 1, "min": 0.1739136595537376, "max": 0.1739136595537376}}} #metrics {"StartTime": 1616445882.6776319, "EndTime": 1616445882.677641, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1735488613467701, "count": 1, "min": 0.1735488613467701, "max": 0.1735488613467701}}} #metrics {"StartTime": 1616445882.6776783, "EndTime": 1616445882.677688, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1738488490179284, "count": 1, "min": 0.1738488490179284, "max": 0.1738488490179284}}} #metrics {"StartTime": 1616445882.677714, "EndTime": 1616445882.6777234, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17354876457513468, "count": 1, "min": 0.17354876457513468, "max": 0.17354876457513468}}} #metrics {"StartTime": 1616445882.677753, "EndTime": 1616445882.6777627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17384864342895745, "count": 1, "min": 0.17384864342895745, "max": 0.17384864342895745}}} #metrics {"StartTime": 1616445882.6777906, "EndTime": 1616445882.6777997, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437826449299654, "count": 1, "min": 0.4437826449299654, "max": 0.4437826449299654}}} #metrics {"StartTime": 1616445882.6778247, "EndTime": 1616445882.6778338, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44283626570607704, "count": 1, "min": 0.44283626570607704, "max": 0.44283626570607704}}} #metrics {"StartTime": 1616445882.6778624, "EndTime": 1616445882.6778717, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.443818897614776, "count": 1, "min": 0.443818897614776, "max": 0.443818897614776}}} #metrics {"StartTime": 1616445882.677901, "EndTime": 1616445882.67791, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44283546717090344, "count": 1, "min": 0.44283546717090344, "max": 0.44283546717090344}}} #metrics {"StartTime": 1616445882.677941, "EndTime": 1616445882.6779523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4445174361535668, "count": 1, "min": 0.4445174361535668, "max": 0.4445174361535668}}} #metrics {"StartTime": 1616445882.677982, "EndTime": 1616445882.6779916, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4416958559695046, "count": 1, "min": 0.4416958559695046, "max": 0.4416958559695046}}} #metrics {"StartTime": 1616445882.6780212, "EndTime": 1616445882.6780295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.444519109017083, "count": 1, "min": 0.444519109017083, "max": 0.444519109017083}}} #metrics {"StartTime": 1616445882.678066, "EndTime": 1616445882.6780748, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4416965535373495, "count": 1, "min": 0.4416965535373495, "max": 0.4416965535373495}}} #metrics {"StartTime": 1616445882.6781046, "EndTime": 1616445882.6781127, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6845253836628561, "count": 1, "min": 0.6845253836628561, "max": 0.6845253836628561}}} #metrics {"StartTime": 1616445882.6781428, "EndTime": 1616445882.6781507, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.683065486229204, "count": 1, "min": 0.683065486229204, "max": 0.683065486229204}}} #metrics {"StartTime": 1616445882.678175, "EndTime": 1616445882.6781824, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846015549856487, "count": 1, "min": 0.6846015549856487, "max": 0.6846015549856487}}} #metrics {"StartTime": 1616445882.6782136, "EndTime": 1616445882.6782222, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6832719725371464, "count": 1, "min": 0.6832719725371464, "max": 0.6832719725371464}}} #metrics {"StartTime": 1616445882.6782527, "EndTime": 1616445882.678262, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6841854475101554, "count": 1, "min": 0.6841854475101554, "max": 0.6841854475101554}}} #metrics {"StartTime": 1616445882.6782968, "EndTime": 1616445882.6783066, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682097970455996, "count": 1, "min": 0.682097970455996, "max": 0.682097970455996}}} #metrics {"StartTime": 1616445882.6783407, "EndTime": 1616445882.6783504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6841850439115305, "count": 1, "min": 0.6841850439115305, "max": 0.6841850439115305}}} #metrics {"StartTime": 1616445882.6783853, "EndTime": 1616445882.6783955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.682097972892205, "count": 1, "min": 0.682097972892205, "max": 0.682097972892205}}} [03/22/2021 20:44:42 INFO 139901614024512] #quality_metric: host=algo-1, epoch=11, validation binary_classification_cross_entropy_objective <loss>=0.15524973887087753 [03/22/2021 20:44:42 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=11, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:44:42 INFO 139901614024512] Epoch 11: Loss improved. Updating best model [03/22/2021 20:44:42 INFO 139901614024512] Saving model for epoch: 11 [03/22/2021 20:44:42 INFO 139901614024512] Saved checkpoint to "/tmp/tmp7z4kef4k/mx-mod-0000.params" [03/22/2021 20:44:42 INFO 139901614024512] #progress_metric: host=algo-1, completed 80.0 % of epochs #metrics {"StartTime": 1616445871.421483, "EndTime": 1616445882.683592, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 11, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5423532.0, "count": 1, "min": 5423532, "max": 5423532}, "Total Batches Seen": {"sum": 5424.0, "count": 1, "min": 5424, "max": 5424}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 14.0, "count": 1, "min": 14, "max": 14}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:44:42 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=40041.94931713597 records/second [2021-03-22 20:44:52.687] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 27, "duration": 10003, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445892.6875286, "EndTime": 1616445892.68761, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15279867470635308, "count": 1, "min": 0.15279867470635308, "max": 0.15279867470635308}}} #metrics {"StartTime": 1616445892.6876879, "EndTime": 1616445892.6877031, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1388235863071018, "count": 1, "min": 0.1388235863071018, "max": 0.1388235863071018}}} #metrics {"StartTime": 1616445892.687754, "EndTime": 1616445892.6877658, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1518080883110894, "count": 1, "min": 0.1518080883110894, "max": 0.1518080883110894}}} #metrics {"StartTime": 1616445892.6877987, "EndTime": 1616445892.6878095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13868276326497395, "count": 1, "min": 0.13868276326497395, "max": 0.13868276326497395}}} #metrics {"StartTime": 1616445892.6878462, "EndTime": 1616445892.6878576, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13705345186021592, "count": 1, "min": 0.13705345186021592, "max": 0.13705345186021592}}} #metrics {"StartTime": 1616445892.6878927, "EndTime": 1616445892.6879034, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13963109741210938, "count": 1, "min": 0.13963109741210938, "max": 0.13963109741210938}}} #metrics {"StartTime": 1616445892.6879523, "EndTime": 1616445892.6879616, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13705503089057075, "count": 1, "min": 0.13705503089057075, "max": 0.13705503089057075}}} #metrics {"StartTime": 1616445892.687998, "EndTime": 1616445892.6880078, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1396304470316569, "count": 1, "min": 0.1396304470316569, "max": 0.1396304470316569}}} #metrics {"StartTime": 1616445892.6880395, "EndTime": 1616445892.6880481, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1726767679511176, "count": 1, "min": 0.1726767679511176, "max": 0.1726767679511176}}} #metrics {"StartTime": 1616445892.6880865, "EndTime": 1616445892.6880958, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718376173570421, "count": 1, "min": 0.1718376173570421, "max": 0.1718376173570421}}} #metrics {"StartTime": 1616445892.6881213, "EndTime": 1616445892.6881306, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1725417342122396, "count": 1, "min": 0.1725417342122396, "max": 0.1725417342122396}}} #metrics {"StartTime": 1616445892.6881635, "EndTime": 1616445892.6881745, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17183762603759767, "count": 1, "min": 0.17183762603759767, "max": 0.17183762603759767}}} #metrics {"StartTime": 1616445892.688204, "EndTime": 1616445892.688213, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717282108900282, "count": 1, "min": 0.1717282108900282, "max": 0.1717282108900282}}} #metrics {"StartTime": 1616445892.6882484, "EndTime": 1616445892.688258, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1736784214952257, "count": 1, "min": 0.1736784214952257, "max": 0.1736784214952257}}} #metrics {"StartTime": 1616445892.6882944, "EndTime": 1616445892.6883044, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717281815592448, "count": 1, "min": 0.1717281815592448, "max": 0.1717281815592448}}} #metrics {"StartTime": 1616445892.6883354, "EndTime": 1616445892.6883442, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17367842112223308, "count": 1, "min": 0.17367842112223308, "max": 0.17367842112223308}}} #metrics {"StartTime": 1616445892.6883783, "EndTime": 1616445892.6883874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44392415818956166, "count": 1, "min": 0.44392415818956166, "max": 0.44392415818956166}}} #metrics {"StartTime": 1616445892.6884208, "EndTime": 1616445892.6884308, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439974065483941, "count": 1, "min": 0.4439974065483941, "max": 0.4439974065483941}}} #metrics {"StartTime": 1616445892.6884656, "EndTime": 1616445892.6884758, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44392746602376304, "count": 1, "min": 0.44392746602376304, "max": 0.44392746602376304}}} #metrics {"StartTime": 1616445892.6885118, "EndTime": 1616445892.688522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399744913736977, "count": 1, "min": 0.44399744913736977, "max": 0.44399744913736977}}} #metrics {"StartTime": 1616445892.6885557, "EndTime": 1616445892.6885657, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439365243191189, "count": 1, "min": 0.4439365243191189, "max": 0.4439365243191189}}} #metrics {"StartTime": 1616445892.6885998, "EndTime": 1616445892.6886103, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44499200391981336, "count": 1, "min": 0.44499200391981336, "max": 0.44499200391981336}}} #metrics {"StartTime": 1616445892.688645, "EndTime": 1616445892.6886544, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439365256754557, "count": 1, "min": 0.4439365256754557, "max": 0.4439365256754557}}} #metrics {"StartTime": 1616445892.6886914, "EndTime": 1616445892.6887019, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44499201212565104, "count": 1, "min": 0.44499201212565104, "max": 0.44499201212565104}}} #metrics {"StartTime": 1616445892.688737, "EndTime": 1616445892.6887455, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684442204047309, "count": 1, "min": 0.684442204047309, "max": 0.684442204047309}}} #metrics {"StartTime": 1616445892.6887784, "EndTime": 1616445892.6887875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845348738606771, "count": 1, "min": 0.6845348738606771, "max": 0.6845348738606771}}} #metrics {"StartTime": 1616445892.6888216, "EndTime": 1616445892.6888304, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477610948351, "count": 1, "min": 0.6844477610948351, "max": 0.6844477610948351}}} #metrics {"StartTime": 1616445892.6888647, "EndTime": 1616445892.688874, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845350786675347, "count": 1, "min": 0.6845350786675347, "max": 0.6845350786675347}}} #metrics {"StartTime": 1616445892.6889076, "EndTime": 1616445892.6889167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844607853190104, "count": 1, "min": 0.6844607853190104, "max": 0.6844607853190104}}} #metrics {"StartTime": 1616445892.6889517, "EndTime": 1616445892.6889613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856965962727865, "count": 1, "min": 0.6856965962727865, "max": 0.6856965962727865}}} #metrics {"StartTime": 1616445892.6889954, "EndTime": 1616445892.689005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844609206814236, "count": 1, "min": 0.6844609206814236, "max": 0.6844609206814236}}} #metrics {"StartTime": 1616445892.6890414, "EndTime": 1616445892.6890504, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856965965440538, "count": 1, "min": 0.6856965965440538, "max": 0.6856965965440538}}} [03/22/2021 20:44:52 INFO 139901614024512] #quality_metric: host=algo-1, epoch=12, train binary_classification_cross_entropy_objective <loss>=0.15279867470635308 [2021-03-22 20:44:53.666] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 38, "duration": 963, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445894.3118744, "EndTime": 1616445894.3119347, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15515898216779464, "count": 1, "min": 0.15515898216779464, "max": 0.15515898216779464}}} #metrics {"StartTime": 1616445894.312003, "EndTime": 1616445894.3120122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14140820566677806, "count": 1, "min": 0.14140820566677806, "max": 0.14140820566677806}}} #metrics {"StartTime": 1616445894.312041, "EndTime": 1616445894.3120494, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15403614216754258, "count": 1, "min": 0.15403614216754258, "max": 0.15403614216754258}}} #metrics {"StartTime": 1616445894.3120809, "EndTime": 1616445894.31209, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14123883331120174, "count": 1, "min": 0.14123883331120174, "max": 0.14123883331120174}}} #metrics {"StartTime": 1616445894.312126, "EndTime": 1616445894.3121357, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1399105148491378, "count": 1, "min": 0.1399105148491378, "max": 0.1399105148491378}}} #metrics {"StartTime": 1616445894.3121743, "EndTime": 1616445894.3121839, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14142913249910607, "count": 1, "min": 0.14142913249910607, "max": 0.14142913249910607}}} #metrics {"StartTime": 1616445894.3122194, "EndTime": 1616445894.3122287, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1399125861681711, "count": 1, "min": 0.1399125861681711, "max": 0.1399125861681711}}} #metrics {"StartTime": 1616445894.3122606, "EndTime": 1616445894.3122673, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1414290475701533, "count": 1, "min": 0.1414290475701533, "max": 0.1414290475701533}}} #metrics {"StartTime": 1616445894.312288, "EndTime": 1616445894.312295, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17448755900065105, "count": 1, "min": 0.17448755900065105, "max": 0.17448755900065105}}} #metrics {"StartTime": 1616445894.31233, "EndTime": 1616445894.3123395, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17391465264726916, "count": 1, "min": 0.17391465264726916, "max": 0.17391465264726916}}} #metrics {"StartTime": 1616445894.312378, "EndTime": 1616445894.3123875, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17428643573614136, "count": 1, "min": 0.17428643573614136, "max": 0.17428643573614136}}} #metrics {"StartTime": 1616445894.312422, "EndTime": 1616445894.3124318, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1739155087040442, "count": 1, "min": 0.1739155087040442, "max": 0.1739155087040442}}} #metrics {"StartTime": 1616445894.3124661, "EndTime": 1616445894.3124757, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1735296523801524, "count": 1, "min": 0.1735296523801524, "max": 0.1735296523801524}}} #metrics {"StartTime": 1616445894.3125074, "EndTime": 1616445894.3125157, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17391105903597065, "count": 1, "min": 0.17391105903597065, "max": 0.17391105903597065}}} #metrics {"StartTime": 1616445894.3125484, "EndTime": 1616445894.312558, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1735296230102994, "count": 1, "min": 0.1735296230102994, "max": 0.1735296230102994}}} #metrics {"StartTime": 1616445894.31259, "EndTime": 1616445894.312598, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17391091929231528, "count": 1, "min": 0.17391091929231528, "max": 0.17391091929231528}}} #metrics {"StartTime": 1616445894.312629, "EndTime": 1616445894.3126373, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4437926000920259, "count": 1, "min": 0.4437926000920259, "max": 0.4437926000920259}}} #metrics {"StartTime": 1616445894.312671, "EndTime": 1616445894.31268, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4430539677788946, "count": 1, "min": 0.4430539677788946, "max": 0.4430539677788946}}} #metrics {"StartTime": 1616445894.3127131, "EndTime": 1616445894.3127224, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44382143939283697, "count": 1, "min": 0.44382143939283697, "max": 0.44382143939283697}}} #metrics {"StartTime": 1616445894.3127577, "EndTime": 1616445894.312767, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44305271042435856, "count": 1, "min": 0.44305271042435856, "max": 0.44305271042435856}}} #metrics {"StartTime": 1616445894.3127987, "EndTime": 1616445894.3128104, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44421814165154266, "count": 1, "min": 0.44421814165154266, "max": 0.44421814165154266}}} #metrics {"StartTime": 1616445894.3128417, "EndTime": 1616445894.3128512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4419441649481107, "count": 1, "min": 0.4419441649481107, "max": 0.4419441649481107}}} #metrics {"StartTime": 1616445894.3128812, "EndTime": 1616445894.3128905, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.444218847881464, "count": 1, "min": 0.444218847881464, "max": 0.444218847881464}}} #metrics {"StartTime": 1616445894.3129175, "EndTime": 1616445894.3129272, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44194445079663386, "count": 1, "min": 0.44194445079663386, "max": 0.44194445079663386}}} #metrics {"StartTime": 1616445894.3129587, "EndTime": 1616445894.3129683, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684495622121592, "count": 1, "min": 0.684495622121592, "max": 0.684495622121592}}} #metrics {"StartTime": 1616445894.313, "EndTime": 1616445894.3130093, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6832181520785172, "count": 1, "min": 0.6832181520785172, "max": 0.6832181520785172}}} #metrics {"StartTime": 1616445894.3130455, "EndTime": 1616445894.3130553, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846114432873065, "count": 1, "min": 0.6846114432873065, "max": 0.6846114432873065}}} #metrics {"StartTime": 1616445894.3130848, "EndTime": 1616445894.3130946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6832834966178056, "count": 1, "min": 0.6832834966178056, "max": 0.6832834966178056}}} #metrics {"StartTime": 1616445894.3131268, "EndTime": 1616445894.3131366, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844493043746258, "count": 1, "min": 0.6844493043746258, "max": 0.6844493043746258}}} #metrics {"StartTime": 1616445894.3131702, "EndTime": 1616445894.3131797, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834472721215573, "count": 1, "min": 0.6834472721215573, "max": 0.6834472721215573}}} #metrics {"StartTime": 1616445894.3132164, "EndTime": 1616445894.3132267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844485778429628, "count": 1, "min": 0.6844485778429628, "max": 0.6844485778429628}}} #metrics {"StartTime": 1616445894.3132553, "EndTime": 1616445894.3132656, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834472667077596, "count": 1, "min": 0.6834472667077596, "max": 0.6834472667077596}}} [03/22/2021 20:44:54 INFO 139901614024512] #quality_metric: host=algo-1, epoch=12, validation binary_classification_cross_entropy_objective <loss>=0.15515898216779464 [03/22/2021 20:44:54 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=12, criteria=sampled_accuracy, value=0.9505765478091184 [03/22/2021 20:44:54 INFO 139901614024512] Epoch 12: Loss improved. Updating best model [03/22/2021 20:44:54 INFO 139901614024512] Saving model for epoch: 12 [03/22/2021 20:44:54 INFO 139901614024512] Saved checkpoint to "/tmp/tmpzbrxo7fk/mx-mod-0000.params" [03/22/2021 20:44:54 INFO 139901614024512] #progress_metric: host=algo-1, completed 86.66666666666667 % of epochs #metrics {"StartTime": 1616445882.6839037, "EndTime": 1616445894.3184967, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 12, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 5874493.0, "count": 1, "min": 5874493, "max": 5874493}, "Total Batches Seen": {"sum": 5875.0, "count": 1, "min": 5875, "max": 5875}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:44:54 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=38759.97996749844 records/second [2021-03-22 20:45:04.415] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 29, "duration": 10094, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445904.41529, "EndTime": 1616445904.4153836, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1527195467291938, "count": 1, "min": 0.1527195467291938, "max": 0.1527195467291938}}} #metrics {"StartTime": 1616445904.4154737, "EndTime": 1616445904.415492, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13850199517144096, "count": 1, "min": 0.13850199517144096, "max": 0.13850199517144096}}} #metrics {"StartTime": 1616445904.4155457, "EndTime": 1616445904.4155588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1513355579630534, "count": 1, "min": 0.1513355579630534, "max": 0.1513355579630534}}} #metrics {"StartTime": 1616445904.4156036, "EndTime": 1616445904.4156163, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13838581368340386, "count": 1, "min": 0.13838581368340386, "max": 0.13838581368340386}}} #metrics {"StartTime": 1616445904.4156606, "EndTime": 1616445904.4156733, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13705021136813694, "count": 1, "min": 0.13705021136813694, "max": 0.13705021136813694}}} #metrics {"StartTime": 1616445904.415714, "EndTime": 1616445904.4157252, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13954653834025066, "count": 1, "min": 0.13954653834025066, "max": 0.13954653834025066}}} #metrics {"StartTime": 1616445904.4157662, "EndTime": 1616445904.4157782, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13705197287665474, "count": 1, "min": 0.13705197287665474, "max": 0.13705197287665474}}} #metrics {"StartTime": 1616445904.415819, "EndTime": 1616445904.4158292, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13954613959418402, "count": 1, "min": 0.13954613959418402, "max": 0.13954613959418402}}} #metrics {"StartTime": 1616445904.4159174, "EndTime": 1616445904.415932, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17264631761338975, "count": 1, "min": 0.17264631761338975, "max": 0.17264631761338975}}} #metrics {"StartTime": 1616445904.4159784, "EndTime": 1616445904.4159899, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.171833308207194, "count": 1, "min": 0.171833308207194, "max": 0.171833308207194}}} #metrics {"StartTime": 1616445904.416031, "EndTime": 1616445904.4160414, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17239150058322483, "count": 1, "min": 0.17239150058322483, "max": 0.17239150058322483}}} #metrics {"StartTime": 1616445904.4160798, "EndTime": 1616445904.41609, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718332662963867, "count": 1, "min": 0.1718332662963867, "max": 0.1718332662963867}}} #metrics {"StartTime": 1616445904.4161332, "EndTime": 1616445904.4161444, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17172131473117405, "count": 1, "min": 0.17172131473117405, "max": 0.17172131473117405}}} #metrics {"StartTime": 1616445904.416186, "EndTime": 1616445904.416196, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17360870561387803, "count": 1, "min": 0.17360870561387803, "max": 0.17360870561387803}}} #metrics {"StartTime": 1616445904.4162364, "EndTime": 1616445904.4162471, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717212974717882, "count": 1, "min": 0.1717212974717882, "max": 0.1717212974717882}}} #metrics {"StartTime": 1616445904.4162889, "EndTime": 1616445904.4163005, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17360870730929903, "count": 1, "min": 0.17360870730929903, "max": 0.17360870730929903}}} #metrics {"StartTime": 1616445904.4163418, "EndTime": 1616445904.4163532, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439219493950738, "count": 1, "min": 0.4439219493950738, "max": 0.4439219493950738}}} #metrics {"StartTime": 1616445904.416393, "EndTime": 1616445904.4164042, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399616183810764, "count": 1, "min": 0.44399616183810764, "max": 0.44399616183810764}}} #metrics {"StartTime": 1616445904.4164574, "EndTime": 1616445904.416469, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439275463189019, "count": 1, "min": 0.4439275463189019, "max": 0.4439275463189019}}} #metrics {"StartTime": 1616445904.4165094, "EndTime": 1616445904.4165204, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399618916829425, "count": 1, "min": 0.44399618916829425, "max": 0.44399618916829425}}} #metrics {"StartTime": 1616445904.4165604, "EndTime": 1616445904.4165711, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439357198757595, "count": 1, "min": 0.4439357198757595, "max": 0.4439357198757595}}} #metrics {"StartTime": 1616445904.4166143, "EndTime": 1616445904.4166267, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44499783026801215, "count": 1, "min": 0.44499783026801215, "max": 0.44499783026801215}}} #metrics {"StartTime": 1616445904.4166675, "EndTime": 1616445904.4166787, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393571485731337, "count": 1, "min": 0.44393571485731337, "max": 0.44393571485731337}}} #metrics {"StartTime": 1616445904.4167235, "EndTime": 1616445904.4167345, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44499783108181423, "count": 1, "min": 0.44499783108181423, "max": 0.44499783108181423}}} #metrics {"StartTime": 1616445904.4167776, "EndTime": 1616445904.4167883, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844420769585503, "count": 1, "min": 0.6844420769585503, "max": 0.6844420769585503}}} #metrics {"StartTime": 1616445904.4168272, "EndTime": 1616445904.4168386, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845338465711805, "count": 1, "min": 0.6845338465711805, "max": 0.6845338465711805}}} #metrics {"StartTime": 1616445904.416881, "EndTime": 1616445904.4168928, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477988009983, "count": 1, "min": 0.6844477988009983, "max": 0.6844477988009983}}} #metrics {"StartTime": 1616445904.4169388, "EndTime": 1616445904.4169483, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845339108615451, "count": 1, "min": 0.6845339108615451, "max": 0.6845339108615451}}} #metrics {"StartTime": 1616445904.4169865, "EndTime": 1616445904.4169962, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.684453512641059, "count": 1, "min": 0.684453512641059, "max": 0.684453512641059}}} #metrics {"StartTime": 1616445904.4170325, "EndTime": 1616445904.4170427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856495141601563, "count": 1, "min": 0.6856495141601563, "max": 0.6856495141601563}}} #metrics {"StartTime": 1616445904.4170768, "EndTime": 1616445904.417087, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844534319390191, "count": 1, "min": 0.6844534319390191, "max": 0.6844534319390191}}} #metrics {"StartTime": 1616445904.4171247, "EndTime": 1616445904.4171348, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856495136176215, "count": 1, "min": 0.6856495136176215, "max": 0.6856495136176215}}} [03/22/2021 20:45:04 INFO 139901614024512] #quality_metric: host=algo-1, epoch=13, train binary_classification_cross_entropy_objective <loss>=0.1527195467291938 [2021-03-22 20:45:05.547] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 41, "duration": 1110, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445906.3824234, "EndTime": 1616445906.3825145, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.15509890518608047, "count": 1, "min": 0.15509890518608047, "max": 0.15509890518608047}}} #metrics {"StartTime": 1616445906.382594, "EndTime": 1616445906.3826053, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14107490649180188, "count": 1, "min": 0.14107490649180188, "max": 0.14107490649180188}}} #metrics {"StartTime": 1616445906.3826401, "EndTime": 1616445906.3826475, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1535939836324435, "count": 1, "min": 0.1535939836324435, "max": 0.1535939836324435}}} #metrics {"StartTime": 1616445906.3826747, "EndTime": 1616445906.3826826, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14097274366117907, "count": 1, "min": 0.14097274366117907, "max": 0.14097274366117907}}} #metrics {"StartTime": 1616445906.3827171, "EndTime": 1616445906.3827262, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13990889294299333, "count": 1, "min": 0.13990889294299333, "max": 0.13990889294299333}}} #metrics {"StartTime": 1616445906.3827615, "EndTime": 1616445906.3827708, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144306030598267, "count": 1, "min": 0.14144306030598267, "max": 0.14144306030598267}}} #metrics {"StartTime": 1616445906.3828163, "EndTime": 1616445906.3828268, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1399109597956434, "count": 1, "min": 0.1399109597956434, "max": 0.1399109597956434}}} #metrics {"StartTime": 1616445906.382861, "EndTime": 1616445906.3828712, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14144303195121674, "count": 1, "min": 0.14144303195121674, "max": 0.14144303195121674}}} #metrics {"StartTime": 1616445906.3829074, "EndTime": 1616445906.3829167, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17446450454579276, "count": 1, "min": 0.17446450454579276, "max": 0.17446450454579276}}} #metrics {"StartTime": 1616445906.3829563, "EndTime": 1616445906.382968, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17391601117215133, "count": 1, "min": 0.17391601117215133, "max": 0.17391601117215133}}} #metrics {"StartTime": 1616445906.383007, "EndTime": 1616445906.383017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17414880231147079, "count": 1, "min": 0.17414880231147079, "max": 0.17414880231147079}}} #metrics {"StartTime": 1616445906.3830535, "EndTime": 1616445906.3830636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1739165782674695, "count": 1, "min": 0.1739165782674695, "max": 0.1739165782674695}}} #metrics {"StartTime": 1616445906.383101, "EndTime": 1616445906.3831122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17352480073759313, "count": 1, "min": 0.17352480073759313, "max": 0.17352480073759313}}} #metrics {"StartTime": 1616445906.3831527, "EndTime": 1616445906.3831627, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17396912127283842, "count": 1, "min": 0.17396912127283842, "max": 0.17396912127283842}}} #metrics {"StartTime": 1616445906.3831995, "EndTime": 1616445906.3832095, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17352478767680599, "count": 1, "min": 0.17352478767680599, "max": 0.17352478767680599}}} #metrics {"StartTime": 1616445906.3832438, "EndTime": 1616445906.3832545, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1739690301180182, "count": 1, "min": 0.1739690301180182, "max": 0.1739690301180182}}} #metrics {"StartTime": 1616445906.3832915, "EndTime": 1616445906.383301, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44380309338558643, "count": 1, "min": 0.44380309338558643, "max": 0.44380309338558643}}} #metrics {"StartTime": 1616445906.3833356, "EndTime": 1616445906.3833454, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.443215356609892, "count": 1, "min": 0.443215356609892, "max": 0.443215356609892}}} #metrics {"StartTime": 1616445906.3833818, "EndTime": 1616445906.3833914, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44382315285983653, "count": 1, "min": 0.44382315285983653, "max": 0.44382315285983653}}} #metrics {"StartTime": 1616445906.3834271, "EndTime": 1616445906.3834364, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.443214192101988, "count": 1, "min": 0.443214192101988, "max": 0.443214192101988}}} #metrics {"StartTime": 1616445906.3834777, "EndTime": 1616445906.3834898, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44397749076059617, "count": 1, "min": 0.44397749076059617, "max": 0.44397749076059617}}} #metrics {"StartTime": 1616445906.3835278, "EndTime": 1616445906.3835368, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44239873258446216, "count": 1, "min": 0.44239873258446216, "max": 0.44239873258446216}}} #metrics {"StartTime": 1616445906.38357, "EndTime": 1616445906.3835785, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4439777963694812, "count": 1, "min": 0.4439777963694812, "max": 0.4439777963694812}}} #metrics {"StartTime": 1616445906.3836155, "EndTime": 1616445906.3836255, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4423988584552607, "count": 1, "min": 0.4423988584552607, "max": 0.4423988584552607}}} #metrics {"StartTime": 1616445906.3836617, "EndTime": 1616445906.3836725, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844769179916179, "count": 1, "min": 0.6844769179916179, "max": 0.6844769179916179}}} #metrics {"StartTime": 1616445906.3837094, "EndTime": 1616445906.3837192, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6833018031043323, "count": 1, "min": 0.6833018031043323, "max": 0.6833018031043323}}} #metrics {"StartTime": 1616445906.383755, "EndTime": 1616445906.3837655, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846166186073009, "count": 1, "min": 0.6846166186073009, "max": 0.6846166186073009}}} #metrics {"StartTime": 1616445906.383804, "EndTime": 1616445906.3838134, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6833357798285532, "count": 1, "min": 0.6833357798285532, "max": 0.6833357798285532}}} #metrics {"StartTime": 1616445906.38385, "EndTime": 1616445906.383859, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.684613433399373, "count": 1, "min": 0.684613433399373, "max": 0.684613433399373}}} #metrics {"StartTime": 1616445906.383894, "EndTime": 1616445906.3839023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842475121000546, "count": 1, "min": 0.6842475121000546, "max": 0.6842475121000546}}} #metrics {"StartTime": 1616445906.3839371, "EndTime": 1616445906.383946, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846200964309993, "count": 1, "min": 0.6846200964309993, "max": 0.6846200964309993}}} #metrics {"StartTime": 1616445906.383983, "EndTime": 1616445906.383992, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6842475045207377, "count": 1, "min": 0.6842475045207377, "max": 0.6842475045207377}}} [03/22/2021 20:45:06 INFO 139901614024512] #quality_metric: host=algo-1, epoch=13, validation binary_classification_cross_entropy_objective <loss>=0.15509890518608047 [03/22/2021 20:45:06 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=13, criteria=sampled_accuracy, value=0.9505942877417066 [03/22/2021 20:45:06 INFO 139901614024512] Epoch 13: Loss improved. Updating best model [03/22/2021 20:45:06 INFO 139901614024512] Saving model for epoch: 13 [03/22/2021 20:45:06 INFO 139901614024512] Saved checkpoint to "/tmp/tmpes_5md3b/mx-mod-0000.params" [03/22/2021 20:45:06 INFO 139901614024512] #progress_metric: host=algo-1, completed 93.33333333333333 % of epochs #metrics {"StartTime": 1616445894.321027, "EndTime": 1616445906.3936613, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 13, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6325454.0, "count": 1, "min": 6325454, "max": 6325454}, "Total Batches Seen": {"sum": 6326.0, "count": 1, "min": 6326, "max": 6326}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 16.0, "count": 1, "min": 16, "max": 16}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:45:06 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=37353.63996476394 records/second [2021-03-22 20:45:16.250] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/train", "epoch": 31, "duration": 9855, "num_examples": 451, "num_bytes": 66742228} #metrics {"StartTime": 1616445916.2500608, "EndTime": 1616445916.2501447, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1526610284254286, "count": 1, "min": 0.1526610284254286, "max": 0.1526610284254286}}} #metrics {"StartTime": 1616445916.250225, "EndTime": 1616445916.2502391, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13824509823269315, "count": 1, "min": 0.13824509823269315, "max": 0.13824509823269315}}} #metrics {"StartTime": 1616445916.2502823, "EndTime": 1616445916.2502944, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.15087578282674155, "count": 1, "min": 0.15087578282674155, "max": 0.15087578282674155}}} #metrics {"StartTime": 1616445916.2503357, "EndTime": 1616445916.2503476, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13814843354966905, "count": 1, "min": 0.13814843354966905, "max": 0.13814843354966905}}} #metrics {"StartTime": 1616445916.2503877, "EndTime": 1616445916.2503984, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13704422436184352, "count": 1, "min": 0.13704422436184352, "max": 0.13704422436184352}}} #metrics {"StartTime": 1616445916.2504482, "EndTime": 1616445916.2504575, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13947165351019966, "count": 1, "min": 0.13947165351019966, "max": 0.13947165351019966}}} #metrics {"StartTime": 1616445916.250492, "EndTime": 1616445916.2505014, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.13704584684583876, "count": 1, "min": 0.13704584684583876, "max": 0.13704584684583876}}} #metrics {"StartTime": 1616445916.2505348, "EndTime": 1616445916.2505436, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1394714274936252, "count": 1, "min": 0.1394714274936252, "max": 0.1394714274936252}}} #metrics {"StartTime": 1616445916.250579, "EndTime": 1616445916.2505891, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17262343404134114, "count": 1, "min": 0.17262343404134114, "max": 0.17262343404134114}}} #metrics {"StartTime": 1616445916.2506232, "EndTime": 1616445916.250633, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718279621717665, "count": 1, "min": 0.1718279621717665, "max": 0.1718279621717665}}} #metrics {"StartTime": 1616445916.2506623, "EndTime": 1616445916.2506719, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17226164391411675, "count": 1, "min": 0.17226164391411675, "max": 0.17226164391411675}}} #metrics {"StartTime": 1616445916.2507045, "EndTime": 1616445916.250713, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1718278999159071, "count": 1, "min": 0.1718278999159071, "max": 0.1718278999159071}}} #metrics {"StartTime": 1616445916.250745, "EndTime": 1616445916.2507546, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17171563273111978, "count": 1, "min": 0.17171563273111978, "max": 0.17171563273111978}}} #metrics {"StartTime": 1616445916.2507904, "EndTime": 1616445916.2508142, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17353626098632813, "count": 1, "min": 0.17353626098632813, "max": 0.17353626098632813}}} #metrics {"StartTime": 1616445916.2508492, "EndTime": 1616445916.2508588, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.1717156191338433, "count": 1, "min": 0.1717156191338433, "max": 0.1717156191338433}}} #metrics {"StartTime": 1616445916.2508924, "EndTime": 1616445916.2509017, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.17353626254611546, "count": 1, "min": 0.17353626254611546, "max": 0.17353626254611546}}} #metrics {"StartTime": 1616445916.250936, "EndTime": 1616445916.2509456, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439221196831597, "count": 1, "min": 0.4439221196831597, "max": 0.4439221196831597}}} #metrics {"StartTime": 1616445916.2509787, "EndTime": 1616445916.2509885, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399459784613715, "count": 1, "min": 0.44399459784613715, "max": 0.44399459784613715}}} #metrics {"StartTime": 1616445916.2510216, "EndTime": 1616445916.2510302, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439275946044922, "count": 1, "min": 0.4439275946044922, "max": 0.4439275946044922}}} #metrics {"StartTime": 1616445916.2510648, "EndTime": 1616445916.2510743, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44399462103949655, "count": 1, "min": 0.44399462103949655, "max": 0.44399462103949655}}} #metrics {"StartTime": 1616445916.251109, "EndTime": 1616445916.2511182, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4439370005967882, "count": 1, "min": 0.4439370005967882, "max": 0.4439370005967882}}} #metrics {"StartTime": 1616445916.2511537, "EndTime": 1616445916.2511632, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.4450104214816623, "count": 1, "min": 0.4450104214816623, "max": 0.4450104214816623}}} #metrics {"StartTime": 1616445916.2511985, "EndTime": 1616445916.2512083, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44393699849446616, "count": 1, "min": 0.44393699849446616, "max": 0.44393699849446616}}} #metrics {"StartTime": 1616445916.251243, "EndTime": 1616445916.2512522, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.44501042277018227, "count": 1, "min": 0.44501042277018227, "max": 0.44501042277018227}}} #metrics {"StartTime": 1616445916.251286, "EndTime": 1616445916.251296, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844419113498263, "count": 1, "min": 0.6844419113498263, "max": 0.6844419113498263}}} #metrics {"StartTime": 1616445916.2513285, "EndTime": 1616445916.2513378, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.68453232421875, "count": 1, "min": 0.68453232421875, "max": 0.68453232421875}}} #metrics {"StartTime": 1616445916.2513726, "EndTime": 1616445916.2513812, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844477882215712, "count": 1, "min": 0.6844477882215712, "max": 0.6844477882215712}}} #metrics {"StartTime": 1616445916.2514172, "EndTime": 1616445916.251427, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6845323257107205, "count": 1, "min": 0.6845323257107205, "max": 0.6845323257107205}}} #metrics {"StartTime": 1616445916.251463, "EndTime": 1616445916.2514722, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844492712402344, "count": 1, "min": 0.6844492712402344, "max": 0.6844492712402344}}} #metrics {"StartTime": 1616445916.2515051, "EndTime": 1616445916.2515144, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.685624693060981, "count": 1, "min": 0.685624693060981, "max": 0.685624693060981}}} #metrics {"StartTime": 1616445916.2515495, "EndTime": 1616445916.251559, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6844492587619357, "count": 1, "min": 0.6844492587619357, "max": 0.6844492587619357}}} #metrics {"StartTime": 1616445916.2515938, "EndTime": 1616445916.251603, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"train_binary_classification_cross_entropy_objective": {"sum": 0.6856246926540799, "count": 1, "min": 0.6856246926540799, "max": 0.6856246926540799}}} [03/22/2021 20:45:16 INFO 139901614024512] #quality_metric: host=algo-1, epoch=14, train binary_classification_cross_entropy_objective <loss>=0.1526610284254286 [2021-03-22 20:45:17.246] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 44, "duration": 981, "num_examples": 57, "num_bytes": 8342760} #metrics {"StartTime": 1616445917.892503, "EndTime": 1616445917.8925576, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 0}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1550451176162728, "count": 1, "min": 0.1550451176162728, "max": 0.1550451176162728}}} #metrics {"StartTime": 1616445917.8926253, "EndTime": 1616445917.8926363, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 1}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1408514678235043, "count": 1, "min": 0.1408514678235043, "max": 0.1408514678235043}}} #metrics {"StartTime": 1616445917.892664, "EndTime": 1616445917.8926723, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 2}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1531659801483831, "count": 1, "min": 0.1531659801483831, "max": 0.1531659801483831}}} #metrics {"StartTime": 1616445917.892707, "EndTime": 1616445917.8927155, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 3}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14075545878915346, "count": 1, "min": 0.14075545878915346, "max": 0.14075545878915346}}} #metrics {"StartTime": 1616445917.89275, "EndTime": 1616445917.892759, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 4}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.13990734588260323, "count": 1, "min": 0.13990734588260323, "max": 0.13990734588260323}}} #metrics {"StartTime": 1616445917.8927968, "EndTime": 1616445917.892805, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 5}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14150805579065875, "count": 1, "min": 0.14150805579065875, "max": 0.14150805579065875}}} #metrics {"StartTime": 1616445917.8928423, "EndTime": 1616445917.8928523, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 6}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.1399093741619441, "count": 1, "min": 0.1399093741619441, "max": 0.1399093741619441}}} #metrics {"StartTime": 1616445917.8928857, "EndTime": 1616445917.8928955, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 7}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.14150795698884913, "count": 1, "min": 0.14150795698884913, "max": 0.14150795698884913}}} #metrics {"StartTime": 1616445917.892932, "EndTime": 1616445917.8929415, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 8}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17444280496150313, "count": 1, "min": 0.17444280496150313, "max": 0.17444280496150313}}} #metrics {"StartTime": 1616445917.8929744, "EndTime": 1616445917.8929825, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 9}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17390965070414885, "count": 1, "min": 0.17390965070414885, "max": 0.17390965070414885}}} #metrics {"StartTime": 1616445917.8930137, "EndTime": 1616445917.893023, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 10}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17403157721264514, "count": 1, "min": 0.17403157721264514, "max": 0.17403157721264514}}} #metrics {"StartTime": 1616445917.893057, "EndTime": 1616445917.8930664, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 11}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17391008949245948, "count": 1, "min": 0.17391008949245948, "max": 0.17391008949245948}}} #metrics {"StartTime": 1616445917.893102, "EndTime": 1616445917.8931084, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 12}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17352537026912032, "count": 1, "min": 0.17352537026912032, "max": 0.17352537026912032}}} #metrics {"StartTime": 1616445917.8931425, "EndTime": 1616445917.8931513, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 13}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17402076443734268, "count": 1, "min": 0.17402076443734268, "max": 0.17402076443734268}}} #metrics {"StartTime": 1616445917.8931906, "EndTime": 1616445917.8932002, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 14}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17352535741135058, "count": 1, "min": 0.17352535741135058, "max": 0.17352535741135058}}} #metrics {"StartTime": 1616445917.8932366, "EndTime": 1616445917.8932467, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 15}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.17402071104376202, "count": 1, "min": 0.17402071104376202, "max": 0.17402071104376202}}} #metrics {"StartTime": 1616445917.8932798, "EndTime": 1616445917.8932865, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 16}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44380195757081076, "count": 1, "min": 0.44380195757081076, "max": 0.44380195757081076}}} #metrics {"StartTime": 1616445917.893307, "EndTime": 1616445917.8933122, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 17}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44340385422123774, "count": 1, "min": 0.44340385422123774, "max": 0.44340385422123774}}} #metrics {"StartTime": 1616445917.893336, "EndTime": 1616445917.8933434, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 18}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4438242954418595, "count": 1, "min": 0.4438242954418595, "max": 0.4438242954418595}}} #metrics {"StartTime": 1616445917.893374, "EndTime": 1616445917.8933823, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 19}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4434027790409973, "count": 1, "min": 0.4434027790409973, "max": 0.4434027790409973}}} #metrics {"StartTime": 1616445917.8934147, "EndTime": 1616445917.8934228, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 20}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4438360815503315, "count": 1, "min": 0.4438360815503315, "max": 0.4438360815503315}}} #metrics {"StartTime": 1616445917.8934577, "EndTime": 1616445917.8934672, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 21}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4428536624038856, "count": 1, "min": 0.4428536624038856, "max": 0.4428536624038856}}} #metrics {"StartTime": 1616445917.8935025, "EndTime": 1616445917.893512, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 22}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.4438361654641972, "count": 1, "min": 0.4438361654641972, "max": 0.4438361654641972}}} #metrics {"StartTime": 1616445917.8935456, "EndTime": 1616445917.893555, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 23}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.44285369217977344, "count": 1, "min": 0.44285369217977344, "max": 0.44285369217977344}}} #metrics {"StartTime": 1616445917.8935895, "EndTime": 1616445917.8936, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 24}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6844818288475905, "count": 1, "min": 0.6844818288475905, "max": 0.6844818288475905}}} #metrics {"StartTime": 1616445917.8936274, "EndTime": 1616445917.8936334, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 25}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834346292795855, "count": 1, "min": 0.6834346292795855, "max": 0.6834346292795855}}} #metrics {"StartTime": 1616445917.8936555, "EndTime": 1616445917.8936636, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 26}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846163384432655, "count": 1, "min": 0.6846163384432655, "max": 0.6846163384432655}}} #metrics {"StartTime": 1616445917.8936942, "EndTime": 1616445917.8937025, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 27}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6834590877352273, "count": 1, "min": 0.6834590877352273, "max": 0.6834590877352273}}} #metrics {"StartTime": 1616445917.8937354, "EndTime": 1616445917.8937433, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 28}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846132677371607, "count": 1, "min": 0.6846132677371607, "max": 0.6846132677371607}}} #metrics {"StartTime": 1616445917.8937767, "EndTime": 1616445917.8937852, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 29}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854599962679444, "count": 1, "min": 0.6854599962679444, "max": 0.6854599962679444}}} #metrics {"StartTime": 1616445917.893819, "EndTime": 1616445917.893828, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 30}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6846114267752232, "count": 1, "min": 0.6846114267752232, "max": 0.6846114267752232}}} #metrics {"StartTime": 1616445917.893858, "EndTime": 1616445917.8938665, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "model": 31}, "Metrics": {"validation_binary_classification_cross_entropy_objective": {"sum": 0.6854599962679444, "count": 1, "min": 0.6854599962679444, "max": 0.6854599962679444}}} [03/22/2021 20:45:17 INFO 139901614024512] #quality_metric: host=algo-1, epoch=14, validation binary_classification_cross_entropy_objective <loss>=0.1550451176162728 [03/22/2021 20:45:17 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9506297676068832 [03/22/2021 20:45:17 INFO 139901614024512] Epoch 14: Loss improved. Updating best model [03/22/2021 20:45:17 INFO 139901614024512] Saving model for epoch: 14 [03/22/2021 20:45:17 INFO 139901614024512] Saved checkpoint to "/tmp/tmprrn_hodt/mx-mod-0000.params" [03/22/2021 20:45:17 INFO 139901614024512] #progress_metric: host=algo-1, completed 100.0 % of epochs #metrics {"StartTime": 1616445906.3940246, "EndTime": 1616445917.899298, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "epoch": 14, "Meta": "training_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 6776415.0, "count": 1, "min": 6776415, "max": 6776415}, "Total Batches Seen": {"sum": 6777.0, "count": 1, "min": 6777, "max": 6777}, "Max Records Seen Between Resets": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Max Batches Seen Between Resets": {"sum": 451.0, "count": 1, "min": 451, "max": 451}, "Reset Count": {"sum": 17.0, "count": 1, "min": 17, "max": 17}, "Number of Records Since Last Reset": {"sum": 450961.0, "count": 1, "min": 450961, "max": 450961}, "Number of Batches Since Last Reset": {"sum": 451.0, "count": 1, "min": 451, "max": 451}}} [03/22/2021 20:45:17 INFO 139901614024512] #throughput_metric: host=algo-1, train throughput=39195.644041574415 records/second [03/22/2021 20:45:17 WARNING 139901614024512] wait_for_all_workers will not sync workers since the kv store is not running distributed [03/22/2021 20:45:17 WARNING 139901614024512] wait_for_all_workers will not sync workers since the kv store is not running distributed [2021-03-22 20:45:19.016] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 47, "duration": 1105, "num_examples": 57, "num_bytes": 8342760} [03/22/2021 20:45:19 INFO 139901614024512] #early_stopping_criteria_metric: host=algo-1, epoch=14, criteria=sampled_accuracy, value=0.9506297676068832 [03/22/2021 20:45:19 INFO 139901614024512] Epoch 14: Loss improved. Updating best model [2021-03-22 20:45:19.778] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/validation", "epoch": 49, "duration": 116, "num_examples": 57, "num_bytes": 8342760} [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.13990734588260323) [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('binary_classification_accuracy', 0.9506120276742949) [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('binary_f_1.000', 0.9499730458221024) [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('precision', 0.9699471598414795) [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('recall', 0.9308049862666385) [03/22/2021 20:45:19 INFO 139901614024512] #validation_score (algo-1) : ('roc_auc_score', 0.9842829829668692) [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation binary_classification_cross_entropy_objective <loss>=0.13990734588260323 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation binary_classification_accuracy <score>=0.9506120276742949 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation binary_f_1.000 <score>=0.9499730458221024 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation precision <score>=0.9699471598414795 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation recall <score>=0.9308049862666385 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, validation roc_auc_score <score>=0.9842829829668692 [03/22/2021 20:45:19 INFO 139901614024512] Best model found for hyperparameters: {"optimizer": "adam", "learning_rate": 0.1, "wd": 0.0001, "l1": 0.0, "lr_scheduler_step": 10, "lr_scheduler_factor": 0.99, "lr_scheduler_minimum_lr": 1e-05} [03/22/2021 20:45:19 INFO 139901614024512] Saved checkpoint to "/tmp/tmpfr1tjiiq/mx-mod-0000.params" [2021-03-22 20:45:19.802] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 0, "duration": 176845, "num_examples": 1, "num_bytes": 148000} [2021-03-22 20:45:19.921] [tensorio] [info] epoch_stats={"data_pipeline": "/opt/ml/input/data/test", "epoch": 1, "duration": 119, "num_examples": 57, "num_bytes": 8342908} #metrics {"StartTime": 1616445919.8017724, "EndTime": 1616445919.9404593, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training", "Meta": "test_data_iter"}, "Metrics": {"Total Records Seen": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Total Batches Seen": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Max Records Seen Between Resets": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Max Batches Seen Between Resets": {"sum": 57.0, "count": 1, "min": 57, "max": 57}, "Reset Count": {"sum": 1.0, "count": 1, "min": 1, "max": 1}, "Number of Records Since Last Reset": {"sum": 56371.0, "count": 1, "min": 56371, "max": 56371}, "Number of Batches Since Last Reset": {"sum": 57.0, "count": 1, "min": 57, "max": 57}}} [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('binary_classification_cross_entropy_objective', 0.13882656841457744) [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('binary_classification_accuracy', 0.9512870092778202) [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('binary_f_1.000', 0.9505456903072435) [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('precision', 0.97093451066961) [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('recall', 0.9309955549283849) [03/22/2021 20:45:19 INFO 139901614024512] #test_score (algo-1) : ('roc_auc_score', 0.9844567723189669) [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test binary_classification_cross_entropy_objective <loss>=0.13882656841457744 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test binary_classification_accuracy <score>=0.9512870092778202 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test binary_f_1.000 <score>=0.9505456903072435 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test precision <score>=0.97093451066961 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test recall <score>=0.9309955549283849 [03/22/2021 20:45:19 INFO 139901614024512] #quality_metric: host=algo-1, test roc_auc_score <score>=0.9844567723189669 #metrics {"StartTime": 1616445742.9501572, "EndTime": 1616445919.944293, "Dimensions": {"Algorithm": "Linear Learner", "Host": "algo-1", "Operation": "training"}, "Metrics": {"initialize.time": {"sum": 192.7943229675293, "count": 1, "min": 192.7943229675293, "max": 192.7943229675293}, "epochs": {"sum": 15.0, "count": 1, "min": 15, "max": 15}, "check_early_stopping.time": {"sum": 12.27879524230957, "count": 16, "min": 0.6732940673828125, "max": 0.8955001831054688}, "update.time": {"sum": 174675.22621154785, "count": 15, "min": 10921.531677246094, "max": 12764.039993286133}, "finalize.time": {"sum": 1899.9574184417725, "count": 1, "min": 1899.9574184417725, "max": 1899.9574184417725}, "setuptime": {"sum": 20.565509796142578, "count": 1, "min": 20.565509796142578, "max": 20.565509796142578}, "totaltime": {"sum": 177188.65418434143, "count": 1, "min": 177188.65418434143, "max": 177188.65418434143}}} 2021-03-22 20:45:32 Uploading - Uploading generated training model 2021-03-22 20:45:32 Completed - Training job completed Training seconds: 215 Billable seconds: 215
mean Target increase the recall 0.930.
Another part of the model tuning phase is to perform hyperparameter optimization. This section gives you an opportunity to tune your hyperparameters to see the extent to which tuning improves your model performance. Use the following template code to help you get started launching an Amazon SageMaker hyperparameter tuning job and viewing the evaluation metrics. Use the following questions to help guide you through the rest of the section.
from sagemaker.tuner import IntegerParameter, CategoricalParameter, ContinuousParameter, HyperparameterTuner
hyperparameter_ranges = {'wd': ContinuousParameter(1e-5, 1),
'l1': ContinuousParameter(1e-5, 0.01),
'learning_rate': ContinuousParameter(1e-4, 0.1)
}
objective_metric_name = 'test:recall'
tuner = HyperparameterTuner(linear_estimator_smote_co_target,
objective_metric_name,
hyperparameter_ranges,
max_jobs=6,
max_parallel_jobs=3)
tuner.fit([train_records_smote, val_records_smote, test_records_smote], include_cls_metadata=False,wait=False)
Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1. Defaulting to the only supported framework/algorithm version: 1. Ignoring framework/algorithm version: 1.
After you launch a tuning job, you can see its progress by calling the describe_tuning_job API. The output from describe-tuning-job is a JSON object that contains information about the current state of the tuning job. You can call list_training_jobs_for_tuning_job to see a detailed list of the training jobs that the tuning job launched.
sagemaker_client = boto3.client('sagemaker')
job_name = tuner.latest_tuning_job.job_name
tuning_job_result = sagemaker_client.describe_hyper_parameter_tuning_job(HyperParameterTuningJobName=job_name)
tuner_describe = sagemaker_client.describe_hyper_parameter_tuning_job(
HyperParameterTuningJobName=job_name)['HyperParameterTuningJobStatus']
tuner_describe
'InProgress'
from pprint import pprint
best_objective = 0
prev_job_count=0
while(1):
status = tuning_job_result['HyperParameterTuningJobStatus']
job_count = tuning_job_result['TrainingJobStatusCounters']['Completed']
if job_count == 0:
print("No training jobs have reported results yet.")
#the current one is Better than the best one.
elif (job_count!=prev_job_count) and tuning_job_result.get('BestTrainingJob',None):
prev_job_count = job_count
if best_objective < tuning_job_result['BestTrainingJob']['FinalHyperParameterTuningJobObjectiveMetric']['Value'] :
print("New best model found:")
pprint(tuning_job_result['BestTrainingJob'])
best_objective = tuning_job_result['BestTrainingJob']['FinalHyperParameterTuningJobObjectiveMetric']['Value']
else:
print("Best model found so far:")
pprint(tuning_job_result['BestTrainingJob'])
if status != 'Completed':
print('Reminder: the tuning job has not been completed.')
print("training jobs status:")
print(tuning_job_result['TrainingJobStatusCounters'])
print('*'*50)
else:
objective_status = tuning_job_result['ObjectiveStatusCounters']
print(objective_status)
print("Best model found is:")
pprint(tuning_job_result['BestTrainingJob'])
break
time.sleep(20)
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
No training jobs have reported results yet.
Reminder: the tuning job has not been completed.
training jobs status:
{'Completed': 0, 'InProgress': 0, 'RetryableError': 0, 'NonRetryableError': 0, 'Stopped': 0}
**************************************************
--------------------------------------------------------------------------- KeyboardInterrupt Traceback (most recent call last) <ipython-input-205-2b5e676f1907> in <module> 35 break 36 ---> 37 time.sleep(20) KeyboardInterrupt:
client = boto3.Session().client('sagemaker')
tuning_job_result = client.describe_hyper_parameter_tuning_job(HyperParameterTuningJobName=tuner.latest_tuning_job.job_name)
status = tuning_job_result['HyperParameterTuningJobStatus']
while status != 'Completed':
print('Reminder: the tuning job has not been completed.')
job_count = tuning_job_result['TrainingJobStatusCounters']['Completed']
print("%d training jobs have completed" % job_count)
time.sleep(180)
tuning_job_result = client.describe_hyper_parameter_tuning_job(HyperParameterTuningJobName=tuner.latest_tuning_job.job_name)
status = tuning_job_result['HyperParameterTuningJobStatus']
print("\n\n All training jobs have completed")
is_minimize = (tuning_job_result['HyperParameterTuningJobConfig']['HyperParameterTuningJobObjective']['Type'] != 'Maximize')
objective_name = tuning_job_result['HyperParameterTuningJobConfig']['HyperParameterTuningJobObjective']['MetricName']
All training jobs have completed
You can list hyperparameters and objective metrics of all training jobs and pick up the training job with the best objective metric.
tuner_analytics = sagemaker.HyperparameterTuningJobAnalytics(tuner.latest_tuning_job.job_name)
df_analytic = pd.DataFrame()
full_df = tuner_analytics.dataframe()
if len(full_df) > 0:
df_analytic = full_df[full_df['FinalObjectiveValue'] > -float('inf')]
if len(df_analytic) > 0:
df_analytic = df_analytic.sort_values('FinalObjectiveValue', ascending=is_minimize)
print("Number of training jobs with valid objective: %d" % len(df_analytic))
print({"lowest":min(df_analytic['FinalObjectiveValue']),"highest": max(df_analytic['FinalObjectiveValue'])})
pd.set_option('display.max_colwidth', -1) # Don't truncate TrainingJobName
else:
print("No training jobs have reported valid results yet.")
df_analytic
Number of training jobs with valid objective: 6
{'lowest': 0.8347209692001343, 'highest': 0.9314894676208496}
/home/ec2-user/anaconda3/envs/python3/lib/python3.6/site-packages/ipykernel/__main__.py:11: FutureWarning: Passing a negative integer is deprecated in version 1.0 and will not be supported in future version. Instead, use None to not limit the column width.
| l1 | learning_rate | wd | TrainingJobName | TrainingJobStatus | FinalObjectiveValue | TrainingStartTime | TrainingEndTime | TrainingElapsedTimeSeconds | |
|---|---|---|---|---|---|---|---|---|---|
| 4 | 0.001777 | 0.008025 | 0.000026 | linear-learner-210322-2221-002-dc9de069 | Completed | 0.931489 | 2021-03-22 22:23:50+00:00 | 2021-03-22 22:25:11+00:00 | 81.0 |
| 1 | 0.000048 | 0.052844 | 0.003595 | linear-learner-210322-2221-005-3bbe2072 | Completed | 0.919918 | 2021-03-22 22:27:47+00:00 | 2021-03-22 22:29:07+00:00 | 80.0 |
| 2 | 0.001755 | 0.021122 | 0.257124 | linear-learner-210322-2221-004-0dae0957 | Completed | 0.906618 | 2021-03-22 22:27:29+00:00 | 2021-03-22 22:28:36+00:00 | 67.0 |
| 0 | 0.000097 | 0.003585 | 0.725663 | linear-learner-210322-2221-006-9643e166 | Completed | 0.898681 | 2021-03-22 22:28:02+00:00 | 2021-03-22 22:29:41+00:00 | 99.0 |
| 3 | 0.000046 | 0.000482 | 0.079967 | linear-learner-210322-2221-003-23e2f210 | Completed | 0.873809 | 2021-03-22 22:23:57+00:00 | 2021-03-22 22:25:13+00:00 | 76.0 |
| 5 | 0.000138 | 0.000170 | 0.000171 | linear-learner-210322-2221-001-a9b3c8c2 | Completed | 0.834721 | 2021-03-22 22:23:50+00:00 | 2021-03-22 22:25:05+00:00 | 75.0 |
Deploy this as your final model and evaluate it on the test set.
tuned_model_deploy = tuner.deploy(initial_instance_count=1, instance_type='ml.m4.xlarge')
Then, because you're training with the CSV file format, create s3_inputs that the training function can use as a pointer to the files in Amazon S3.
predict_batches(tuned_model_deploy, test_features, test_labels)